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PREFACE 


PREFACE TO THE FIRST EDITION 


Every aspect of this book was influenced by the desire to present calculus not 
merely as a prelude to but as the first real encounter with mathematics. Since 
the foundations of analysis provided the arena mm which modern modes of math- 
ematical thinkmg developed, calculus ought to be the place in which to expect, 
rather than avoid, the strengthening of insight with logic. In addition to devel- 
oping the students’ intuition about the beautiful concepts of analysis, it is surely 
equally important to persuade them that precision and rigor are neither deterrents 
to mtuition, nor ends in themselves, but the natural medium in which to formulate 
and think about mathematical questions. 


This goal implies a view of mathematics which, im a sense, the entire book 
attempts to defend. No matter how well particular topics may be developed, the 
goals of this book will be realized only if it succeeds as a whole. For this reason, it 
would be of little value merely to list the topics covered, or to mention pedagogical 
practices and other innovations. Even the cursory glance customarily bestowed on 
new calculus texts will probably tell more than any such extended advertisement, 
and teachers with strong feelings about particular aspects of calculus will know just 
where to look to see if this book fulfills their requirements. 

A few features do require explicit comment, however. Of the twenty-nine chap- 
ters in the book, two (starred) chapters are optional, and the three chapters com- 
prismg Part V have been included only for the benefit of those students who might 
want to examine on their own a construction of the real numbers. Moreover, the 
appendices to Chapters 3 and 11 also contain optional material. 

The order of the remaining chapters is intentionally quite inflexible, since the 
purpose of the book is to present calculus as the evolution of one idea, not as a 
collection of “topics.” Since the most exciting concepts of calculus do not appear 
until Part IIE, it should be pointed out that Parts I and IT will probably require 
less time than their length suggests —although the entire book covers a one-year 
course, the chapters are not meant to be covered at any uniform rate. A rather 
natural dividing pomt does occur between Parts IT and III, so it is possible to 
reach differentiation and integration even more quickly by treating Part II very 
briefly, perhaps returning later for a more detailed treatment. This arrangement 
corresponds to the traditional organization of most calculus courses, but I feel 
that it will only diminish the value of the book for students who have seen a 
small amount of calculus previously, and for bright students with a reasonable 
background. 

The problems have been designed with this particular audience in mind. ‘They 
range from straightforward, but not overly simple, exercises which develop basic 
techniques and test understanding of concepts, to problems of considerable difh- 
culty and, I hope, of comparable interest. “Vhere are about 625 problems in all. 
Those which emphasize manipulations usually contain many examples, numbered 


Vil 
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with small Roman numerals, while small letters are used to label interrelated parts 
in other problems. Some indication of relative difficulty is provided by a system of 
starring and double starring, but there are so many criteria for judging difficulty, 
and so many hints have been provided, especially for harder problems, that this 
guide is not completely reliable. Many problems are so difficult, especially if the 
hints are not consulted, that the best of students will probably have to attempt only 
those which especially interest them; from the less dificult problems it should be 
easy to select a portion which will keep a good class busy, but not frustrated. The 
answer section contains solutions to about half the examples from an assortment 
of problems that should provided a good test of technical competence. A separate 
answer book contains the solutions of the other parts of these problems, and of all 
the other problems as well. Finally, there is a Suggested Reading list, to which the 
problems often refer, and a glossary of symbols. 

[ am grateful for the opportunity to mention the many people to whom I owe my 
thanks. Jane Bjorkgren performed prodigious feats of typing that compensated for 
my fitful production of the manuscript. Richard Serkey helped collect the material 
which provides historical sidelights in the problems, and Richard Weiss supplied 
the answers appearing in the back of the book. I am especially grateful to my 
friends Michael Freeman, Jay Goldman, Anthony Phillips, and Robert Wells for 
the care with which they read, and the relentlessness with which they criticized, a 
preliminary version of the book. Needles to say, they are not responsible for the 
deficiencies which remain, especially since I sometimes rejected suggestions which 
would have made the book appear suitable for a larger group of students. I must 
express my admiration for the editors and staff of W. A. Benjamin, Inc., who were 
always eager to increase the appeal of the book, while recognizing the audience 
for which it was intended. 

The inadequacies which prelimmary editions always involve were gallantly en- 
dured by a rugged group of freshmen in the honors mathematics course at Brandeis 
University during the academic year 1965-1966. About half of this course was 
devoted to algebra and topology, while the other half covered calculus, with the 
preliminary edition as the text. It is almost obligatory in such circumstances to 


report that the preliminary version was a gratifying success. This is always safe 
after all, the class is unlikely to rise up in a body and protest publicly—but the 
students themselves, it seems to me, deserve the right to assign credit for the thor- 
oughness with which they absorbed an impressive amount of mathematics. I am 
content to hope that some other students will be able to use the book to such good 
purpose, and with such enthusiasm. 


Valtham, Massachusetts MICHAEL SPIVAK 
Tebruary 1967 


PREFACE TO THE SECOND EDITION 


L have often been told that the title of this book should really be something like “An 
Introduction to Analysis,” because the book is usually used in courses where the 
students have already learned the mechanical aspects of calculus—such courses are 
standard in Europe, and they are becoming more common in the United States. 
After thirteen years it seems too late to change the title, but other changes, in 
addition to the correction of numerous misprints and mistakes, seemed called for. 
There are now separate Appendices for many topics that were previously slighted: 
polar coordinates, uniform continuity, parameterized curves, Riemann sums, and 
the use of integrals for evaluating lengths, volumes and surface areas. A few topics, 
hike manipulations with power series, have been discussed more thoroughly in the 
text, and there are also more problems on these topics, while other topics, like 
Newton’s method and the trapezoid rule and Simpson’s rule, have been developed 
in the problems. There are in all about 160 new problems, many of which are 
intermediate in difficulty between the few routine problems at the beginning of 
each chapter and the more difficult ones that occur later. 

Most of the new problems are the work of Ted Shifrin. Frederick Gordon 
pointed out several serious mistakes in the original problems, and supplied some 
non-trivial corrections, as well as the neat proof of ‘Theorem 12-2, which took 
two Lemmas and two pages in the first edition. Joseph Lipman also told me 
of this proof, together with the similar trick for the proof of the last theorem in 
the Appendix to Chapter 11, which went unproved in the first edition. Roy O. 
Davies told me the trick for Problem 11-66, which previously was proved only in 
Problem 20-8 [21-8 in the third edition], and Marina Ratner suggested several 
interesting problems, especially ones on uniform continuity and infinite series. ‘To 
all these people go my thanks, and the hope that in the process of fashioning the 
new edition their contributions weren't too badly botched. 


MICHAEL SPIVAK 


PREPACE POSE) THIRD: DITION 


The most significant change in this third edition is the inclusion of a new (starred) 
Chapter 17 on planetary motion, in which calculus is employed for a substantial 
physics problem. 

In preparation for this, the old Appendix to Chapter 4 has been replaced by 
three Appendices: the first two cover vectors and conic sections, while polar coor- 
dinates are now deferred until the third Appendix, which also discusses the polar 
coordinate equations of the conic sections. Moreover, the Appendix to Chapter 12 
has been extended to treat vector operations on vector-valued curves. 

Another large change is merely a rearrangement of old material: “Phe Cos- 
mopolitan Integral,” previously a second Appendix to Chapter 13, ts now an 
Appendix to the chapter on “Integration in Elementary ‘Terms” (previously Chap- 
ter 18, now Chapter 19); moreover, those problems from that chapter which used 
the material from that Appendix now appear as problems in the newly placed 
Appendix. 

A few other changes and renumbering of Problems result from corrections, and 
elimination of incorrect problems. 


IT was both startled and somewhat dismayed when I realized that after allow- 
ing 13 years to elapse between the first and second editions of the book, | have 
allowed another 14 years to clapse before this third edition. During this time I 
seem to have accumulated a not-so-short list of corrections, but no longer have 
the original communications, and therefore cannot properly thank the various m- 
dividuals involved (who by now have probably lost interest anyway). [ have had 
time to make only a few changes to the Suggested Reading, which after all these 
years probably requires a complete revision; this will have to wait untl the next 
edition, which I hope to make in a more timely fashion. 


MICHAEL SPIVAK 


PREFACE TO THE FOURTH EDITION 


Promises, promises! In the preface to the third edition I noted that it was 13 years 
between the first and second editions, and then another 14 years before the third, 
expressing the hope that the next edition would appear sooner. Well, here it is 
another 14 years later before the fourth, and presumably final, edition. 

Although small changes have been made to some material, especially m Chap- 
ters 5 and 20, this edition diflers mainly in the introduction of additional problems, 
a complete update of the Suggested Readmg, and the correction of numerous er- 
rors. ‘These have been brought to my attention over the years by, among others, 
Nils von Barth; Philip Loewen; Fernando Mejias; Lance Miller, who provided a 
long list, particularly for the answer book; and Michael Maltenfort, who provided 
an amazingly extensive list of misprits, errors, and criticisms. 

Most of all, however, | am indebted to my friend ‘Ted Shifrm, who has been 
usmg the book for the text m his renowned course at the University of Georgia 
for all these years, and who prodded and helped me to finally make this needed 
revision. | must also thank the students in his course this last academic year, who 
served as guinea pigs for the new edition, resulting, in particular, m the current 
proof im Problem 8-20 for the Rismg Sun Lemma, far simpler than Reisz’s original 
proof, or even the proof in [38] of the Suggested Reading, which itself has now 
been updated considerably, agam with great help from ‘Ted. 


MICHAEL SPIVAK 
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PROLOGUE 


CHAPTER 


BASIC PROPERTIES OF NUMBERS 


The ttle of this chapter expresses in a few words the mathematical knowledge 
required to read this book. In fact, this short chapter 1s simply an explanation of 
what is meant by the “basic properties of numbers,” all of which—addition and 
multiplication, subtraction and division, solutions of equations and inequalities, 
factoring and other algebraic manipulations—are already familiar to us. Never- 
theless, this chapter is not a review. Despite the familiarity of the subject, the 
survey we are about to undertake will probably seem quite novel; it does not aim 
to present an extended review of old material, but to condense this knowledge 
into a few simple and obvious properties of numbers. Some may even seem too 
obvious to mention, but a surprising number of diverse and important facts turn 
out to be consequences of the ones we shall emphasize. 

Of the twelve properties which we shall study in this chapter, the first nine are 
concerned with the fundamental operations of addition and multiplication. For 
the moment we consider only addition: this operation is performed on a pair 
of numbers—the sum a + Db exists for any two given numbers a and b (which 
may possibly be the same number, of course). It might seem reasonable to regard 
addition as an operation which can be performed on several numbers at once, and 
consider the sum a; +--+ +a, of m numbers a},...,d, as a basic concept. It is 
more convenient, however, to consider addition of pairs of numbers only, and to 
define other sums in terms of sums of this type. For the sum of three numbers 
a, b, and c, this may be done in two different ways. One can first add b and c, 
obtaining b+ c, and then add a to this number, obtainmg a + (b +c); or one can 
first add a and b, and then add the sum a + b to c, obtaining (a+ b)+c. Of 
course, the two compound sums obtained are equal, and this fact is the very first 
property we shall list: 


(Pl) If a,b, and c are any numbers, then 


at+(b+c)=(a+b)+c. 


The statement of this property clearly renders a separate concept of the sum of 
three numbers superfluous; we simply agree that a + b + c denotes the number 
a+(b+c) = (a+b)+c. Addition of four numbers requires similar, though slightly 
more involved, considerations. The symbol a + b + c +d is defined to mean 


l) ((a+b)+c)+d, 
(a+(b+c))+d, 
a (D6) 
a+(b+(c+da)), 


(a+b)+(c+d). 


NR 


or 


es) 


or 


Tk 
eZ NZ NL OL” OS” 


or 
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This definition is unambiguous since these numbers are all equal. Fortunately, his 
fact need not be listed separately, since it follows from the property P1 already 
listed. For example, we know from P1 that 


(at+tb)+c=a+(b+c), 


and it follows immediately that (1) and (2) are equal. The equality of (2) and (3) 
is a direct consequence of Pl, although this may not be apparent at first sight 
(one must let b +c play the role of b in PI, and d the role of c). The equalities 
(3) = (4) = (5) are also simple to prove. 

It is probably obvious that an appeal to P1 will also suffice to prove the equality 
of the 14 possible ways of summing five numbers, but it may not be so clear how we 
can reasonably arrange a proof that this is so without actually listing these 14 sums. 
Such a procedure is feasible, but would soon cease to be if we considered collections 
of six, seven, or more numbers; it would be totally inadequate to prove the equality 
of all possible sums of an arbitrary finite collection of numbers aj,....@n. This 
fact may be taken for granted, but for those who would like to worry about the 
proof (and it is worth worrying about once) a reasonable approach is outlined in 
Problem 24. Henceforth, we shall usually make a tacit appeal to the results of this 
problem and write sums aj +--+ +a, with a blithe disregard for the arrangement 
of parentheses. 

The number 0 has one property so important that we list it next: 


(P2) If @ is any number, then 


a+0=0+a=a. 


An important role is also played by 0 in the third property of our list: 
(P3) For every number a, there is a number —a such that 


a+(-—a) = (-a)+a=0. 


Property P2 ought to represent a distinguishing characteristic of the number 0, 
and it is comforting to note that we are already in a position to prove this. Indeed, 
ifa number x satisfies 

a+x=a 


for any one number a, then x = 0 (and consequently this equation also holds for all 
numbers a). The proof of this assertion involves nothing more than subtracting a 
from both sides of the equation, in other words, adding —a to both sides: as the 
following detailed proof shows, all three properties P]~ P3 must be used to justify 
this operation. 


Ae a+s =a, 
then (—a)+ (a+x)=(-a)+a=0; 
hence ((—a)+a)+.+«=0: 
hence Qepy = 0: 


hence ye es ()), 
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As we have just hinted, it is convenient to regard subtraction as an operation 
derived from addition: we consider a — b to be an abbreviation for a + (—b). It 
is then possible to find the solution of certain simple equations by a series of steps 
(each justified by Pl, P2, or P3) similar to the ones just presented for the equation 
a+x = aq. Torexampie: 


If x4 3 =), 
then (x + 3)+ (—3) =5+ (3); 
hence x+4+ (34+ (—3))=5-3=2; 
hence xO 2: 
hence ee 


Naturally, such elaborate solutions are of interest only until you become convinced 
that they can always be supplied. In practice, it is usually just a waste of time to 
solve an equation by indicating so exphcitly the rellance on properties P1, P2, and 
P3 (or any of the further properties we shall list). 

Only one other property of addition remains to be listed. When considering the 
sums of three numbers a, b, and c, only two sums were mentioned: (a + b) + ¢ 
and a+ (b+ c). Actually, several other arrangements are obtained if the order of 
a, b, and ¢ is changed. ‘That these sums are all equal depends on 


(P4) If a and b are any numbers, then 


atb=b-+a. 


The statement of P4 is meant to emphasize that although the operation of ad- 
dition of pairs of numbers might conceivably depend on the order of the two 
numbers, in fact it does not. It is helpful to remember that not all operations are 
so well behaved. For example, subtraction does not have this property: usually 
a-—b#zb—a. In passing we might ask just when a — b does equal b — a, and it 
is amusing to discover how powerless we are if we rely only on properties P1—P4 
to justify our manipulations. Algebra of the most elementary variety shows that 
a—b=b-—a only whena = b. Nevertheless, it is impossible to derive this fact 
from properties P]~ P4; it is instructive to examine the elementary algebra care- 
fully and determme which step(s) cannot be justified by Pl P4. We will indeed 
be able to justify all steps in detail when a few more properties are listed. Oddly 
enough, however, the crucial property involves multiplication. 

The basic properties of multiplication are fortunately so similar to those for ad- 
dition that littke comment will be needed; both the meaning and the consequences 
should be clear. (As in elementary algebra, the product of a and b will be denoted 
by a- b, or simply ab.) 


(PS) If a, b, and ¢ are any numbers, then 


a eo — (ap) ac, 


(P6) If @ is any number, then 


6 Prologue 


Moreover, | 4 0. 


(The assertion that | 4 0 may seem a strange fact to list, but we have to 
list it, because there is no way it could possibly be proved on the basis of the 
other properties listed these properties would all hold if there were only one 
number, namely, 0.) 


(P7) For every number a ¥ 0, there is a number a~! such that 


qom ae og 


(P8) If a and b are any numbers, then 


Lo — oe 


One detail which deserves emphasis 1s the appearance of the condition a 4 0 
in P7. ‘This condition is quite necessary; since 0-b = 0 for all numbers b, there is no 
number 07! satisfying 0-07! = 1. This restriction has an important consequence 
for division. Just as subtraction was defined in terms of addition, so division is 
defined in terms of multiplication: The symbol a/b means a- b~!. Since 0~! is 
meaningless, a/0 is also meaningless—division by 0 1s always undefined. 

Property P7 has two important consequences. If a-b = a-c, it does not 
necessarily follow that b = c; for if a = 0, then both a-b and a-c are 0, no matter 
what b and c are. However, if a £0, then b = ¢; this can be deduced from P7 as 
follows: 


If a:b =ave and a 4 0, 
then a7'!.(a-b)=a7!. (a @): 
hence (a7! 0) (a7! ONE C8 
hence ly b eee. 

hence b=e 


It is also a consequence of P7 that if a- b = 0, then either a = 0 or b = 0. In fact, 


if a+b = 0 anda U, 
then a7" .(a-b) =0: 
hence (Ag a 
hence i b ="0; 
hence bD— 


(It may happen that a = 0 and 6 = 0 are both true; this possibility is not excluded 
when we say “either @ = 0 or b = 0"; m mathematics “or” is always used mn the 
sense of “one or the other, or both.”) 

This latter consequence of P7 is constantly used m the solution of equations. 
Suppose, for example, that a number x is known to satisfy 


(we — [Ce — 2 0. 


Then it follows that either x — | = 0 or x —2 = 0: hence x = | or x = 2. 
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On the basis of the eight properties listed so far it is still possible to prove very 
little. Listing the next property, which combines the operations of addition and 
multiplication, will alter this situation drastically. 

(P9) If a,b, and ¢ are any numbers, then 
a:(b+c)=a-b+a-c. 


(Notice that the equation (b+ c)-a=b-a-+c-a 1s also true, by P8.) 


As an example of the usefulness of P9 we will now determine just when a — b = 


b—-a: 


If a-b=b—-a., 

then (a—b)+b=(b-—a)+b=b4+(b—-a): 
hence a=b+b-a;: 

hence ata=(b+b—-a)+a=b+b. 
Consequently a-(l+l)=b-(14+1), 

and therefore a. 


A second use of P9 is the justification of the asseruon a-0 = 0 which we have 
already made, and even used m a proof on page 6 (can you find where?). This 
fact was not listed as one of the basic properties, even though no proof was offered 
when it was first mentioned. With Pl P8 alone a proof was not possible, since the 
number Q appears only in P2 and P3, which concern addition, while the assertion 
in question involves multiplication. With P9 the proof is simple, though perhaps 
not obvious: We have 


a-O+a-0=a-(0+0) 
a-0Q; 


as we have already noted, this immediately implies (by adding —(a - 0) to both 
sides) that a- 0 = 0. 

A series of further consequences of P9 may help explain the somewhat myste- 
rious rule that the product of two negative numbers is positive. ‘Lo begin with, 
we will establish the more easily acceptable assertion that (—a)-b = —(a-b). To 
prove this, note that 


(-ad)-b+a-b=[(—a)+a]-b 
rn 
=n 


It foltows immediately (by adding —(a- b) to both sides) that (—a)-b = —(a-b). 
Now note that 


(—a) - (—b) + [-(a- b)| = (—a) - (—b) + (—a) +b 
= (=a)™ [(b)+ 5] 
= (—a) -0 
= (), 


8 Prologue 


Consequently, adding (a - 6) to both sides, we obtain 
(—a) - (—b) =a-b. 


The fact that the product of two negative numbers is positive is thus a consequence 
of P1-P9. In other words, of we want P/ to P9 to be true, the rule for the product of two 
negative numbers is forced upon us. 

The various consequences of P9 examined so far, although interesting and im- 
portant, do not really indicate the significance of P9; after all, we could have listed 
each of these properties separately. Actually, P9 is the justification for almost all 
algebraic manipulations. For example, although we have shown how to solve the 
equation 


GOs 2 i= 02 


we can hardly expect to be presented with an equation in this form. We are more 
likely to be confronted with the equation 


Be eae (Oy 


ws) 
cad 
+ 


The “factorization” x? — 2 = (x — 1)(@ — 2) 1s really a triple use of P9: 


(x —1)-(-— 2) =x- (x —2)+(-1)- (x — 2) 

X> Kesboe + (2) (1) - eee 1) (22) 
x? +x[(-2)+(-l] +2 

BS oe ae 


A final illustration of the importance of P9 is the fact that this property is actually 
used every ume one multiplies arabic numerals. For example, the calculation 


3) 
sale 


is a concise arrangement for the followmg equations: 


13 gl LO a) 
SPP) ED (SE lor 
= 5. OE SD. 


(Note that moving 26 to the left in the above calculation is the same as writing 
26-10.) ‘The multiplication 13 -4 = 52 uses P9 also: 


1I3-4=(1-10+43)-4 
=1-10-44+3.4 
=4-104 12 
=4-104+1-10+2 
= (44+ 1)-1042 
=5-10+2 
57 
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The properties PI~P9 have descriptive names which are not essential to remem- 
ber, but which are often convenient for reference. We will take this opportunity to 
list properties P1~P9 together and indicate the names by which they are commonly 


designated. 

(Pl) (Associative law for addition) Gee (bere mCi alae. 

(P2) (Existence of an additive at0=0+a=a. 
identity) 

(P3) (Existence of additive inverses) a+ (—a) = (-—a)+a=0. 

(P4) (Commutative law for addition) atb=b+a. 

(P5) (Associative law for multiplica- a-(b-c) =(42)) -e 
tion) 

(P6) (Existence of a multiplicative @gil=1-qg=e 
identity) 

(P7) (Existence of multiplicative a-a'!=a!-a=1, fora. 
inverses) 

(P8) (Commutative law for multi- Gab = ba. 


plication) 


(P9) (Distributive law) 


-(b+c)=a-bt+a-c. 


2 


The three basic properties of numbers which remain to be listed are concerned 
with inequalities. Although mequalities occur rarely in elementary mathematics, 
they play a prominent role in calculus. ‘The two notions of inequality, a < b 
(a is less than b) and a > b (a is greater than b), are intimately related: a < b 
means the same as b > a (thus | < 3 and 3 > | are merely two ways of writing 
the same assertion). “The numbers a satisfying a > O are called positive, while 
those numbers a satisfying a < 0 are called negative. While positivity can thus 
be defined in terms of <, it is possible to reverse the procedure: a < b can be 
defined to mean that 6 — a is positive. In fact, it is convenient to consider the 
collection of all positive numbers, denoted by P, as the basic concept, and state 
all properties in terms of P: 


(P10) (Trichotomy law) For every number a, one and only one of the 
following holds: 


Gy ae 0) 
(i) ais in the collection P, 
(1) —a is in the collection P. 


(P11) (Closure under addition) If a and b are in P, then a +b is in P. 


(P12) (Closure under multiplication) If @ and b are in P, then a -b is 
a cae 
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These three properties should be complemented with the following definitions: 


a>bh if a —O isa: 
Gy @ all el = ae 

Ge oil nn Oly daa 
ab Gab) nie 


Note, in particular, that a > O if and only if a is in P. 

All the familar facts about inequalities, however elementary they may seem, are 
consequences of P1O- P12. For example, if a and b are any two numbers, then 
precisely one of the following holds: 


(i) a—b=0O, 
(1) a—bism the collection P, 
(in) —(a—~b) = b—aisim the collection P. 


Using the definitions just made, it follows that precisely one of the following holds: 


(ile @= 0, 
i)" wD, 
(ut), De> Ge 


A slightly more interesting fact results from the followmg manipulations. — If 
a < b, so that b—a is mn P, then surely (b + c) — (a +c) is in P; thus, if a <b, 
then a+c<b+c. Similarly, suppose a < b and b < c. Then 


ba isan 'P, 
and c—bisin P, 
sO Ca =e — ea ise. 


This shows that if a < b and b < cc, then a < c. (The two inequalities a < b and 
b < care usually written in the abbreviated form a < b < c, which has the third 
inequality a < c almost built in.) 

The following assertion is somewhat less obvious: If a < 0 and b < QO, then 
ab > 0. The only difficulty presented by the proof is the unraveling of definitions. 
The symbol a < 0 means, by definition, 0 > a, which means 0 — a = ~a is in P. 
Similarly —b is nm P, and consequently, by P12, (—a)(—b) = ab ism P. Thus 
ab > 0. 

The factthatrab== 0 if aes Osb = 0 and’ also ii a =— 0, b aa) hassone 
special consequence: a> > Oif a #0. Thus squares of nonzero numbers are 
always positive, and m particular we have proved a result which might have seemed 
suflicicutly elementary to be included in our list of properties: 1 > O (sice | = 1°). 
* There is one slightly perplexing feature of the symbols > and <. ‘The statements 
I+1<3 
l+1<2 


are both true, even though we know that < could be replaced by < in the first, and by = m the 
second. ‘Vhis sort of thing is bound to occur when < is used with specific numbers; the usefulness 
of the symbol is revealed by a statement like Vheorem |~ here equality holds for some values of a 
and b, while inequality holds for other values. 


THEOREM 1 


PROOF 
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The fact that -a > 0 if a < 01s the basis of a concept which will play an 
extremely important role in this book. For any number a, we define the absolute 
value |a| of a as follows: 


a, a>Q 


a\|= 
Ie —a, a<Q0. 


Note that |a| is always positive, except when a = 0. For example, we have | — 3| = 
3,17) 7, Witte Qe Sh che 3, and Ide wom 10) 10 2 — I 
In general, the most straightforward approach to any problem involving absolute 
values requires treating several cases separately, since absolute values are defined 
by cases to begin with. This approach may be used to prove the following very 
unportant fact about absolute values. 


For all numbers a and b, we have 


la + b| < |a| + |D|. 


We will consider 4 cases: 


ral) a= US b= 0: 
(2) a0 b= 0: 
(3) a=— (0, b> 0: 
(4) Ga 0!) ba Uy: 


In case (1) we also have a + b > O, and the theorem is obvious; in fact, 
la+tbl|=a+b=|a|+ |b, 


so that in this case equality holds. 
In case (4) we have a+ b < 0, and again equality holds: 


la+b| = —-—(a+b) = —a+(—b) = |a| + |DI. 
In case (2), when a > 0 and b < 0, we must prove that 
la+b|<a-—b. 


This case may therefore be divided into two subcases. If a+b > 0, then we must 
prove that 
a+b<a-—b, 
‘ee, b<—b, 
which is certainly true since b < 0 and hence —b > 0. On the other hand, if 
a+b <0, we must prove that 
—-a-—hb<a-—b, 
Ler =i) S Ql. 
which is certainly true since a > 0 and hence —a < 0. 


Minally, note that case (3) may be disposed of with no additional work, by apply- 
ing case (2) with a and b interchanged. § 
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Although this method of treating absolute values (separate consideration of var- 
lous Cases) is sometimes the only approach available, there are often simpler meth- 
ods which may be used. In fact, it is possible to give a much shorter proof of 
Theorem 1; this proof is motivated by the observation that 


la| = Va2. 
(Here, and throughout the book, /x denotes the positive square root of x; this 
symbol is defined only when x > 0.) We may now observe that 
(la + b|)* = (a +b)? = a* + 2ab +b? 
=" 4 lal eee 

la? + 2a| - |b) + [bP 

9) 
(lal + |b|)°. 


From this we can conclude that |a + b| < Ja] + |b| because x? < y? implies x < y, 
provided that x and y are both nonnegative; a proof of this fact is left to the reader 
(Problem 5). 

One final observation may be made about the theorem we have just proved: a 
close examination of either proof offered shows that 


la + b| = lja| + |D| 


if a and b have the same sign (i.e., are both positive or both negative), or if one of 
the two is 0, while 
la+b| < |a| + |b| 


if a and b are of opposite signs. 

We will conclude this chapter with a subtle point, neglected until now, whose 
inclusion is required in a conscientious survey of the properties of numbers. After 
stating property P9, we proved that a — b = b—a implies a = b. The proof began 
by establishing that 

@-(l lb + Ll), 


from which we concluded that a = b. This result is obtained from the equation 
a-(1+1) = b- (1 +1) by dividing both sides by 1 + 1. Division by 0 should 
be avoided scrupulously, and it must therefore be admitted that the validity of the 
argument depends on knowing that 1+ 1 4 0. Problem 25 is designed to convince 
you that this fact cannot possibly be proved from properties Pl P9 alone! Once 
P10, Pll, and P12 are available, however, the proof is very simple: We have 
already seen that | > 0; it follows that 1 + 1 > 0, and in particular 1+ 1 4 0. 
his last demonstration has perhaps only strengthened your feeling that it 1s 
absurd to bother proving such obvious facts, but an honest assessment of our 
present ‘situation will help justify serious consideration of such details. In this 
chapter we have assumed that numbers are familiar objects, and that Pl -P12 are 
mercly explicit statements of obvious, well-known properties of numbers. It would 
be difficult, however, to justify this assumption. Although one learns how to “work 
with” numbers m school, just what numbers ave, remaims rather vague. A great 
deal of this book is devoted to elucidating the concept of numbers, and by the end 
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of the book we will have become quite well acquainted with them. But it will be 
necessary to work with numbers throughout the book. It 1s therefore reasonable 
to admit frankly that we do not yet thoroughly understand numbers; we may still 
say that, in whatever way numbers are finally defined, they should certamly have 
properties P]—P12. 

Most of this chapter has been an attempt to present convincing evidence that 
Pl P12 are indeed basic properties which we should assume in order to deduce 
other familar properties of numbers. Some of the problems (which indicate the 
derivation of other facts about numbers from P1—P12) are offered as further evi- 
dence. [t is still a crucial question whether P1—P12 actually account for a// prop- 
erties of numbers. As a matter of fact, we shall soon see that they do not. In the 
next chapter the deficiencies of properties P]—P12 will become quite clear, but 
the proper means for correcting these deficiencies is not so easily discovered. ‘The 
crucial additional basic property of numbers which we are seeking is profound and 
subtle, quite unlike Pl- P12. The discovery of this crucial property will require all 
the work of Part I] of this book. In the remainder of Part I we will begin to see 
why some additional property is required; in order to investigate this we will have 
to consider a little more carefully what we mean by “numbers.” 


PROBLEMS 
1. Prove the followmg: 


) Wiax = a for some snmmber ¢ = 0 then x — I. 
. 9 


( 

(i) x“ — y? =(x—y)(x+y). 

ont — then yor ey 

(iv) x3 — yi = (x — yx? + xy + y?). 

(v) vie yf =(x- wis | ie pee =e oy ae vee ). 

(vi) x3 +y2 = (x + y)(x? — xy + y?). (There is a particularly easy way to 


do this, usmg (tv), and it will show you how to find a factorization for 
x" + y" whenever 7 is odd.) 


2. What is wrong with the following “proof”? Let x = vy. Then 


2 


ee 
9) 9) 9 
= Sy 
(Cs yoy) = yi y), 
X+y=y, 
2y=y, 
La, 


3. Prove the following: 
f= tb, cP 0 
be 


7 a G ad+he .. 
ieee areal ae SAN, 
Ws pte fg me Be? 
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(iti) (ab)~! = a~'b™!, if a,b # 0. (To do this you must remember the 
defining property of (ab)~!.) 


aver ae 

iv) —~--=—,if b,dF0. 

hig agp ia 
a cad 

) — | ~=—, if b,c, 

(v) s/s por b.c,d #0 

(vi) If b¥d 10; then : = if and only if ad = bc. Also determine when 
aD 
Ea. 


4. Find all numbers x for which 


(ee a <3 
ii) 5—x*<8. 

(tl) te 

(iv) (x — 1)(x — 3) > 0. (When is a product of two numbers positive?) 
(v) “x? 22x 4 2 20: 

GQipacoee eh bes 

(val) xe — ee Oe lo: 

(viii) x7 +x+1>0. 

(ix) (x—m)(x+5)(x —3) > 0. 
Ei Gr 2G 4/2) = 0 
(xi) DGetS: 
bai 
( 


xl) — + > 0. 
or AS x 

(xiv) ZS 

X1V i 
x+1 


5. Prove the following: 


i) Ifa<bandc <d,thena+c<b+d. 

ii) Ifa <6; then —b < —a. 

(um) If a<b and c > d, thena—c <b—d-. 

(iv) If a<bandc > 0, then ac < be. 

(v) Ifa<bandc <0, then ac > be. 

(vi) Ifa>1, then a? >a. 

(vii) If 0 <a <1, then a? <a. 

(vil) If O< a < band 0 <c <d, then ac < bd. 

(ix) If 0 <a <b, thena® <b’. (Use \viii).) 

(x) If a,b>Oand a? < bd’, thena <b. (Use (ix), backwards.) 
6.:"\(a) aBrovethatif 0i<to = gynthenwk ay ir ais ee fet: 

(b) Prove that if x < y and n is odd, then x” < y”. 

(c) Prove that if x” = y” and n is odd, then x = y. 

(d) Prove that if x” = y” and n is even, then x = yorx =—y. 


#5. 


10. 


11. 
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Prove that if 0 <a < b, then 
b 
Ga OD = se = 2), 


Notice that the mequality Vab < (a + b)/2 holds for all a, b > 0. A gener- 
alization of this fact occurs in Problem 2-22. 


Although the basic properties of inequalities were stated in terms of the col- 
lection P of all positive numbers, and < was defined in terms of P, this 
procedure can be reversed. Suppose that P10 P12 are replaced by 


(P’10) For any numbers a and b one, and only one, of the 


following holds: 
(ec =D 
(il) a= Bb 
(iu Bo 


(P’11) For any numbers a, b, and c, if a < band b < ¢, then 


Cae 
(P’12) For any numbers a, b, and c, if a < b, then 
Ot 6 < Doe cs 
(P’13) For any numbers a, b, and c, if a < b and 0 <c, then 
Gce— De 


Show that P1O-P12 can then be deduced as theorems. 


Express each of the following with at least one less pair of absolute value 
signs. 


G) w I 2 tai ry ee I: 
(ii) = [(ja + b| — Jal — |B))I. 

Gy Gb) lel lace > +c). 
(ive cae) ee 

( 


vy) 1v2+ 43) -1V5 — V7). 


Express each of the following without absolute value signs, treating various 
cases separately when necessary. 


(i) |a+b|—|Dl. 
(i) a) DE 
i 

( 


mi) |x|- eal 
lv) a-—|(a —|a})|. 


Find all numbers x for which 


(1) ene NS Se 
(i) [x — 3] <8. 
(i) |x +4[ <2. 
(wv) |x —1]+ |x —2] > 1. 
(v) lx —1|+ |x 4+1| < 2. 
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t2: 


13. 


14 


“lS. 


elo; 


vi) |x — h)+ lat 1| <eh 
(vVil)eeta= bleglese 1) = 0. 
(vin) |x — 1[- |x +2] = 3. 


Prove the following: 


Q) Ixyl =x] - ly. 

" | rs 1s 

(11) Sait me if x 4 0. (Lhe best way to do this is to remember what 
fy (eas; 

Pea | ay 
1 ae 

(iv) |x — y| < |x| + |y|. (Give a very short proof.) 

(v)  |x|—|y| < |v — y|. (A very short proof is possible, if you write things in 
the right way.) 

(vi) [C(x] — |yP| < |x — »|. (Why does this follow mmediately from (v)?) 


(vn) |x +y +2] < [x] +1y| + lel. Indicate when equality holds, and prove 
your statement. 


The maximum of two numbers x and y is denoted by max(x, y). Thus 


Mmasx(—1, 3) == miax(3, 5) = 3 and max(—!|, —4) = max(—4”~,—1) = —I. 
The minimum of x and y is denoted by min(x, y). Prove that 
ae Va be = 2) 
EEGs.) = 
; a 
| x+y—ly—al 
Miu y) — a” Ga: 


~ 


Derive a formula for max(x, v, z) and min(x, y, Z), using, for example 
Inak(4. yc) = max(y, max(y, 2): 


(a) Prove that |a| = |—a|. (The trick is not to become confused by too many 
cases. First prove the statement for a > 0. Why is it then obvious for 
a < 0?) 

(b) Prove that —b < a < b if and only if |a| < b. In particular, it follows 
that —|a| <a < |a|. 


(c) Use this fact to give a new proof that |a + b| < |a| + [Ob]. 
Prove that if x and y are not both 0, then 
eee eee = 10) 
hie seer Pec oe ty = 0) 
Hint: Use Problem f. 
(a) Show that 


é ) D 9) 
(x + y)* 8x5 + ¥° only when® = 0 or » = 0, 


3 Bees 
(sty)? Sa° + ye nly when'x = 0_of ¥ =10_ome* = > y. 


II 


ly 


18. 


19. 
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(b) Using the fact that 
ee oe ome) 


show that 4x? + 6xy + 4y* > 0 unless x and y are both 0. 

(c) Use part (b) to find out when (x + y)* = x7 + y4. 

(d) Find out when (+ ye = rey, Hint: From the assumption (s-Fy)° = 
oy you should be able to derive the equation x? tO x2 yet 2x y7sey? = 
0, if xy £0. This imphes that (x + y)3 = xy + xy? =i Cay) 


You should now be able to make a good guess as to when (x + y)" = x" + y"; 
the proof 1s contained in Problem 11-63. 


(a) Find the smallest possible value of 2x7 — 3x +4. Hint: “Complete the 
square,” 1.€., write 2x2 S3x tA = Ix = 3/457 +>? 

(b) Find the smallest possible value of x7 — 3x + 2y? + 4y +2. 

(ce) Find the smallest possible value of eee aye oy — 4 Ge 


(a) Suppose that b? — 4c > 0. Show that the numbers 


—b fw b? S46 ND eee 
——5 ee —— 


Zz 


both satisfy the equation x° + bx +¢ = 0. 

(b) Suppose that b? — 4c < 0. Show that there are no numbers x satisfying 
x? + bx +c = 0; in fact, x? + bx +c > 0 for all x. Hint: Complete the 
square. 

(c) Use this fact to give another proof that if x and y are not both 0, then 
BS ae S10), 

(d) For which numbers a is it true that x7 + waxy + y? > 0 whenever x and 
y are not both 0? 

(ec) Find the smallest possible value of x? + bx + ¢ and of ax? + bx +c, for 
d= 0): 


The fact that a* > 0 for all numbers a, elementary as it may seem, is 
nevertheless the fundamental idea upon which most important inequali- 
ties are ultimately based. ‘The great-granddaddy of all inequalities is the 
Schwarz inequality: 


tay eee 
XM ar MDI SS VM ae Xo VV eee. 


(A more general form occurs in Problem 2-21.) The three proofs of the 

Schwarz inequality outlined below have only one thing in common—their 
3 - 4 = 

Tellance othe tact that a— = O for all’a. 


(a) Prove that if xj = Ay; and x2 = Ay2 for some number 4 > 0, then 
equality holds in the Schwarz inequality. Prove the same thing if y; = 
y2 = 0. Now suppose that y; and y2 are not both 0, and that there is no 
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number A such that x; = Ay; and x2 = Ay2. Then 
0 < (Ay) — x1)? + Ayo — 29)? 
=) (y) 2A a ys) = Cele Hat5 7), 


Using Problem 18, complete the proof of the Schwarz inequality. 
(b) Prove the Schwarz inequality by using 2xy < x7+y (how is this derived?) 


with 
XG Vi 
SS y= —__., 
po) zy) 4 2) 
VXIe + X2° V Vie gd 
first for 7 = | and then for 7 = 2. 


(c) Prove the Schwarz mequality by first proving that 
a ip) 2 6) B) wy 
cleat Aree 7) ye 22)" ny. ea ya) 


(d) Deduce, from each of these three proofs, that equality holds only when 
yp = y2 = 0 or when there is a number A = O such that xy = Ay, and 
Do 0 


In our later work, three facts about inequalities will be crucial. Although proofs 


will be supplied at the appropriate pomt in the text, a personal assault on these 
problems 1s infinitely more enlightening than a perusal of a completely worked-out 
proof. ‘The statements of these propositions involve some weird numbers, but their 


basic message is very simple: if x 1s close enough to x9, and y ts close enough to yo, 


then x + y will be close to x9 + yo, and xy will be close to xgy9, and 1/y will be close 
to 1/y9. ‘The symbol “e” which appears in these propositions is the fifth letter of the 
Greek alphabet (“epsilon”), and could just as well be replaced by a less intimidating 


Roman letter; however, tradition has made the use of ¢ almost sacrosanct in the 


contexts to which these theorems apply. 


20. 


ra 


Prove that if . 
|x — xg| < 5 and |y — yol < = 


- “_ 


then 


(Ga cig) | fare 


eS Os) Sai 


Prove that if 


aef é 
|x — x9| < min Greco ) and |y — yo| < 
20yolen) 


then |xv — xoyol < &. 


E 
2(\xol + 1)’ 


(The notation “min” was defined in Problem 13, but the formula provided by 
that problem is irrelevant at the moment; the first equality m the hypothesis 


just means that 


. 
lx — x9| < —————__ and__ [x —x0| < |; 
2(lyo| + 1) 


ooo. 


423, 


2 
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at one point in the argument you will need the first inequality, and at an- 
other point you will need the second. One more word of advice: since the 
hypotheses only provide information about x — x9 and y — yo, it is almost a 
foregone conclusion that the proof will depend upon writing xy — xoyo in a 
way that involves x — x9 and y — yo.) 


Prove that if yo 4 0 and 


2 
Fabel an lvol elyol” 
~ YO 93 4 Y ’ 
then y 4 0 and 
1 ] 
———| <e., 
y 50 


Replace the question marks in the following statement by expressions involv- 
ing €, x9, and yo so that the conclusion will be true: 


If yo 4 O and 
then y 4 0 and 


x XO 


pam RYO 


This problem ts trivial in the sense that its solution follows from Problems 21} 
and 22 with almost no work at all (notice that x/y = x - 1/y). The crucial 
point is not to become confused; decide which of the two problems should 
be used first, and don’t panic if your answer looks unlikely. 


This problem shows that the actual placement of parentheses in a sum Is 
irrelevant. The proofs involve “mathematical induction”; if you are not fa- 
miliar with such proofs, but still want to tackle this problem, it can be saved 
unul after Chapter 2, where proofs by induction are explained. 

Let us agree, for definiteness, that aj + +--+ ad, will denote 


ay + (a2 a (a3 “tear arte (a2 + (4,1 + Gn))) i J 


Thus a) + a2 + a3 denotes ay + (az + a3). and ay + ao + a3 + a4 denotes 
Gl) tee 19,1 4))) 9 COG. 


(a) Prove that 
(ay te a ee) en = re 


Hint: Use induction on k. 


(b) Prove that if n > k, then 
(Gila te Ge ey) = ect lcl Gy. 


Hint: Use part (a) to give a proof by induction on k. 
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745), 


(o)\eliet (aise ax) be some sum formed from aj,..., ax. Show that 
S\(Giieet aes ay) =a, t+---+ ay. 
Hint: There must be two sums s‘(qj,..., aj) and s”(aj41,...,@,) such 
that 
5(a),) a Ss" 3 ea (2) ay). 


Suppose that we interpret “number” to mean either O or 1, and + and - to 
be the operations defined by the following two tables. 


af 0 0 I 
0 0 0 
1 0 1 


Check that properties P1—P9 all hold, even though | + 1 = 0. 


CHAPTER 


NUMBERS OF VARIOUS SORTS 


In Chapter | we used the word “number” very loosely, despite our concern with 
the basic properties of numbers. It will now be necessary to distinguish carefully 
various kinds of numbers. 


The simplest numbers are the “counting numbers” 


The fundamental significance of this collection of numbers is emphasized by its 
symbol N (for natural numbers). A brief glance at P1 P12 will show that our 
basic properties of “numbers” do not apply to N—for example, P2 and P3 do not 
make sense for N. From this point of view the system N has many deficiencies. 
Nevertheless, N is sufficiently important to deserve several comments before we 
consider larger collections of numbers. 

The most basic property of N is the principle of “mathematical induction.” 
Suppose P(x) means that the property P holds for the number x. Then the prin- 
ciple of mathematical induction states that P(x) ts true for all natural numbers x 
provided that 


(1) def ta) as: ines 
(2) Whenever P(k) is true, P(k + 1) is true. 


Note that condition (2) merely asserts the truth of P(k+1) under the assumption 
that P(k) is true; this suffices to ensure the truth of P(x) for all x, if condition 
(1) also holds. In fact, if P(1) is true, then it follows that P(2) is true (by using 
(2) in the special case k = 1). Now, since P(2) is true it follows that P(3) is true 
(using (2) in the special case k = 2). It is clear that each number will eventually be 
reached by a series of steps of this sort, so that P(x) is true for all numbers k. 

A favorite illustration of the reasoning behind mathematical induction envisions 
an infinite line of people, 


person number 1, person number 2, person number 3, ... . 


If each person has been instructed to tell any secret he hears to the person behind 
him (the one with the next largest number) and a secret is told to person number I, 
then clearly every person will eventually learn the secret. If P(¥) 1s the assertion 
that person number x will learn the secret, then the instructions given (to tell all 
secrets learned to the next person) assures that condition (2) is true, and telling 
the secret to person number | makes (1) true. The following example is a less 
facetious use of mathematical induction. There ts a useful and striking formula 
which expresses the sum of the first 2 numbers in a simple way: 


21 
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n(n + 1) 
aes 


pay 


reece 


‘To prove this formula, note first that it 1s clearly true for n = 1. Now assume that 
for some natural number k we have 


k(k+ 1 
(seg 
2 
Then 
k(k+ 1 
oy Sb ecrce qe (2 EM Rs kt! 
_ kG + N+ 2k +2 
= ea 
k? + 3k 42 
=a 
al ated) Cates 2) 
= 


7; 


so the formula is also true for k + 1. By the principle of induction this proves 
the formula for all natural numbers n. ‘This particular example illustrates a phe- 
nomenon that frequently occurs, especially in connection with formulas like the 
one just proved. Although the proof by induction is often quite straightforward, 
the method by which the formula was discovered remains a mystery. Problems 5 
and 6 indicate how some formulas of this type may be derived. 


The principle of mathematical induction may be formulated in an equivalent 
way without speaking of “properties” of a number, a term which is sufficiently 
vague to be eschewed in a mathematical discussion. A more precise formulation 
states that if A is any collection (or “set”-—a synonymous mathematical term) of 
natural numbers and 


(Hh Misti, 
(2). k +1 isin A whenever k is m A, 


then A is the set of all natural numbers. [t should be clear that this formulation 
adequately replaces the less formal one given previously—we Just consider the 
set A of natural numbers x which satisfy P(x). For example, suppose A is the set 
of natural numbers 1 for which it is true that 


n(n + 1) 
ee 


= 


ae 


Our previous proof of this formula showed that A contains 1, and that k + I 1s 
in A, if kis. It follows that A is the set of all natural numbers, 1.c., that the formula 
holds for all natural numbers 7. 

There is yet another rigorous formulation of the principle of mathematical m- 
duction, which looks quite different. If A is any collection of natural numbers, it 
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is tempting to say that A must have a smallest member. Actually, this statement 
can fail to be true in a rather subtle way. A particularly important set of natural 
numbers is the collection A that contains no natural numbers at all, the “empty 
collection” or “null set,’* denoted by 4. The null set 9 is a collection of natural 
numbers that has no smallest member—ain fact, it has no members at all. This 
is the only possible exception, however; if A is a nonnull set of natural numbers, 
then A has a least member. This “intuitively obvious” statement, known as the 
“well-ordering principle,” can be proved from the principle of induction as follows. 
Suppose that the set A has no least member. Let B be the set of natural numbers 
n such that 1,..., are all not in A. Clearly 1 is in B (because if 1 were in A, then 
A would have | as smallest member). Moreover, if 1,....& are not in A, surely 
k + 1 is not in A (otherwise k + 1 would be the smallest member of A), so 1, ..., 
k +1 are all not n A. This shows that if k is in B, then k + 1 is in B. It follows 
that every number 7 is in B, 1.e., the numbers 1, ... , 2 are not in A for any natural 
number #2. ‘Thus A = 4, which completes the proof: 

It is also possible to prove the principle of duction from the well-ordering 
principle (Problem 10). Either principle may be considered as a basic assumption 
about the natural numbers. 

There is still another form of induction which should be mentioned. It some- 
times happens that in order to prove P(k + 1) we must assume not only P(k), but 
also P(/) for all natural numbers / < k. In this case we rely on the “principle of 
complete induction”: If A is a set of natural numbers and 


(1) lisin A, 
(2). *%& Sealeis tive ie... , & are in A. 


then A is the set of all natural numbers. 

Although the principle of complete induction may appear much stronger than 
the ordinary principle of induction, it is actually a consequence of that principle. 
The proof of this fact is left to the reader, with a hint (Problem 11). Applications 
will be found in Problems 7, 17, 20 and 22. 

Closely related to proofs by induction are “recursive definitions.” For example, 
the number n! (read “n factorial”) is defined as the product of all the natural 
numbers less than or equal to 7: 


lea? + Gi = len. 
This can be expressed more precisely as follows: 


) d= 


l 
(2) nl=n-(n—1)!. 


‘This form of the definition exhibits the relationship between n! and (n — 1)! in an 


* Although it may not strike you as a collection, in the ordinary sense of the word, the null set arises 
quite naturally in many contexts. We frequently consider the set A, consisting of all x satisfying some 
property P; often we have no guarantee that P is satisfied by any number, so that A might be 4 in 
fact often one proves that P is always false by showing that A = ¥. 
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explicit way that 1s ideally suited for proofs by induction. Problem 23 reviews a 
definition already familar to you, which may be expressed more succinctly as a re- 
cursive definition; as this problem shows, the recursive definition is really necessary 
for a rigorous proof of some of the basic properties of the definition. 

One definition which may not be familiar involves some convenient notation 
which we will constantly be using. Instead of writing 


ON aR OF ap Op. 


we will usually employ the Greek letter & (capital sigma, for “sum”) and write 
n 
) dj. 
i=l 
H 


In other words, ) aj denotes the sum of the numbers obtained by letting 


i 


i= 1,2.....m. Thus 


l 
Ye Ratha ese 


Hn 
Notice that the letter 7 really has nothing to do with the number denoted by Ms, ie 
vi 


and can be replaced by any convenient symbol (except n, of course!): 


n 


et @ ely 
py ete 
i. 
: eee) 
ye 
j=l 
a =a 
Si Goad) 
er : 


n 


‘To define ) a; precisely really requires a recursive definition: 


i=l 
| 
(SS a= aie 
— 
n n—| 


(2) > a — > ai + dy. 


i=l i=l 
But only purveyors of mathematical austerity would imsist too stronely on such 
Y | ) ; gi 
precision. In practice, all sorts of modifications of this symbolism are used, and 
no one ever considers it necessary to add any words of explanation. ‘The symbol 
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for example, is an obvious way of writing 
A ee ae ee ta, 


or more precisely, 


The deficiencies of the natural numbers which we discovered at the beginning 
of this chapter may be partially remedied by extending this system to the set of 
integers 


2,10, 1,2,.... 


‘This set is denoted by Z (from German “Zahl,” number). Of properties P1—P12, 
only P7 fails for Z. 

A sull larger system of numbers is obtained by taking quotients m/n of integers 
(with n 4 0). ‘These numbers are called rational numbers, and the set of all 
rational numbers is denoted by Q (for “quotients’). In this system of numbers all 
of Pl P12 are true. It is tempting to conclude that the “properties of numbers,” 
which we studied in some detail in Chapter 1, refer to just one set of numbers, 
namely, Q. ‘There is, however, a still larger collection of numbers to which proper- 
ties P1-P12 apply—the set of all real numbers, denoted by R. The real numbers 
include not only the rational numbers, but other numbers as well (the irrational 
numbers) which can be represented by infinite decimals; 2 and V2 are both 
examples of irrational numbers. The proof that z is irrational is not easy — we 
shall devote all of Chapter 16 of Part III to a proof of this fact. The irrationality 
of V2. on the other hand, is quite simple, and was known to the Greeks. (Since the 
Pythagorean theorem shows that an isosceles right triangle, with sides of length 1, 
has a hypotenuse of length V2, it is not surprising that the Greeks should have 
invesugated this question.) The proof depends on a few observations about the 
natural numbers. Every natural number 7 can be written either in the form 2k 
for some integer k, or else in the form 2k + | for some integer k (this “obvious” 
fact has a simple proof by induction (Problem 8)). Those natural numbers of the 
form 2k are called even; those of the form 2k + | are called odd. Note that even 
numbers have even squares, and odd numbers have odd squares: 


Qn)? = aie = 252k), 
(2k + 1)? = 4k? + 4k + 1 = 2- (2k? 42k) +1. 
In particular it follows that the converse must also hold: if n? is even, then 7 is even: 


“nr ae . . . . . . . . 
ifn“ is odd, then n is odd. ‘The proof that V2 is irrational is now quite simple. 


Suppose that J/2 were rational; that is, suppose there were natural numbers p 
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and q such that 


al =e) 
q Si 


We can assume that p and g have no common divisor (since all common divisors 
could be divided out to begin with). Now we have 


oe ae : 5 S 
This shows that p~ is even, and consequently p must be even; that is, p = 2k for 
some natural number k. Then 


~ 


p? = 4k? = 29’, 


sO 
Q ? 


2 =e 
This shows that g* is even, and consequently that g is even. Thus both p and g 
are even, contradicting the fact that p and g have no common divisor. ‘This 
contradiction completes the proof: 

It is important to understand precisely what this proof shows. We have demon- 
strated that there is no rational number x such that x7 = 2. This assertion is often 
expressed more briefly by saying that V2 is irrational. Note, however, that the 
use of the symbol V2 imphes the existence of some number (necessarily irrational) 
whose square is 2. We have not proved that such a number exists and we can as- 
sert confidently that, at present, a proof is impossible for us. Any proof at this stage 
would have to be based on P1~P12 (the only properties of R we have mentioned): 
since Pl P12 are also true for Q the exact same argument would show that there 
is a rational number whose square is 2, and this we know is false. (Note that the 
reverse argument will not work —our proof that there 1s no rational number whose 
square is 2 cannot be used to show that there 1s no real number whose square is 2, 
because our proof used not only P]~ P12 but also a special property of Q, the fact 
that every number in Q can be written p/q for mtegers p and q.) 

This particular deficiency in our list of properties of the real numbers could, 
of course, be corrected by adding a new property which asserts the existence of 
square roots of positive numbers. Resorting to such a measure is, however, neither 
aesthetically pleasing nor mathematically satisfactory; we would sull not know that 
every number has an nth root if # is odd, and that every positive number has an 
nth root if nis even. Even if we assumed this, we could not prove the existence of 
a number x satisfying x> +. + 1 = 0 (even though there does happen to be one), 
smce we do not know how to write the solution of the equation in terms of nth 
roots (mn fact, it is known that the solution cannot be written im this form). And, 
of course, we certaily do not wish to assume that all equations have solutions, 
since this is false (10 real number x satisfies x7 + 1 = 0, for example). In fact, 
this direction of investigation is not a fruitful one. ‘The most useful hints about the 
property distinguishmg R from Q, the most compelling evidence for the necessity 
of elucidating this property, do not come from the study of numbers alone. In 
order to study the properties of the real numbers m1 a more profound way, we 
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must study more than the real numbers. At this point we must begin with the 
foundations of calculus, in particular the fundamental concept on which calculus 
is based—functions. 


PROBLEMS 


1. Prove the following formulas by induction. 


fi) 2 see pee BOFV On +D 


6 
(yy PERSE eer a lee era) 
2. Find a formula for 

() S°Qi-1) =14345+4+---4+Qn-]). 

i=l 
Gi) S°Qi-1? = 1243745? +--+ + Qn 1). 

i=l 
Hint: What do these expressions have to do with 1 +2+3+---+2n and 
17 +27 4+ 32+4..-+4 (2n)?? 


3. If O<k <n, the “binomial coefficient” C is defined by 


a n! n(n—1)---(n—k+1) 
[eG k! 


= —________.,, ifk £0, 
k Hk) on 


(5) = * = | (a special case of the first formula if we define 0! = 1), 
n 


and for k < 0 or k >n we just define the binomial coefficient to be 0. 


Uinta) 


(The proof does not require an induction argument.) 


(a) Prove that 


This relation gives rise to the following configuration, known as “Pas- 
cal’s triangle” —a number not on one of the sides is the sum of the two 


é : Nee 
numbers above it; the binomial coefficient (7) is the (kK + 1)st number 


in the (n + 1)st row. 
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(b) Notice that all the numbers in Pascal’s triangle are natural numbers. Use 
5 : MIN , 
part (a) to prove by induction that i is always a natural number. (Your 


entire proof by induction will, in a sense, be summed up in a glance by 
Pascal’s triangle.) 


F n : : 
(c) Give another proof that f, is a natural number by showing that 


LO \\ ie = : “ 
(7) is the number of sets of exactly k mtegers each chosen from 1, 
it. 


(d) Prove the “binomial theorem”: If a and b are any numbers and n is a 
natural number, then 


(a+by" Se (7 arto (3 arto + + ( n aor! 4 p" 
lz 


# £()-() 


1 odd 


w T()= (Ce (C)enaz 


/ even 
(a) Prove that 


S Bhs.) sre) 


Hint: Apply the binomial theorem to (1 + «)"(1 +x)”. 


(b) Prove that 
= a ig Ga 
ley 9 Net 


k=0 


Ds 
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(a) Prove by induction on n that 
5 1 _— prt 
eS 
l—r 
if r #1 (if r = 1, evaluating the sum certainly presents no problem). 
(b) Derive this result by setting S = 1+r+---+r", multiplying this equation 
by r, and solving the two equations for S. 


The formula for 17 +--- +n? may be derived as follows. We begin with the 
formula 


(eA? Sin Bie 2 Sk a. 


Writing this formula for k = 1, ... , nm and adding, we obtain 


pa eae, 7 sae em | 
BF 2 ne 3D 


(nt DS S88 ne 
(Pood) alee |i eh ye oro, Heobe Seyalptana 


Thus we can find Dake if we already know ik (which could have been 
k=1 KA 
found in a similar way). Use this method to find 


ne 1 l l 

ey) Lye ore n(n +1) 

3 5 2n+ 1 
(iv) CL AoC eT TE 


n 
Use the method of Problem 6 to show that ae can always be written in 
I 
the form 
n p+l 


aa Anan e = One ee oes. 


(The first 10 such expressions are 
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12. 


k=l 
n 
Nie = Lie lt Ty 
= 
ye = qn + sn + in? 
me 
yok = sn + tn? topline) 39/2 
Z, 
pata = Gil + 5n of nt — pn 
rt 
> =tnl + 5n° + tn? — Ln? ae $n 
i 
ee ae sn! + pn? = yn" Sie pr 
i 
ye = 5nr + 5n® + an! pat gue — 4! 
a 
v2) ee ane + in? + an’ = Gn + int - Hie 
rs" 
> ie = qa! + 5nlO >n? =i) a un + aN. 


Notice that the coefficients in the second column are always 5. and that after 
the third column the powers of n with nonzcro coefficients decrease by 2 until 
n? or nis reached. The coefficients in all but the first two columns seem to 
be rather haphazard, but there actually 1s some sort of pattern; finding it may 
be regarded as a super-perspicacity test. See Problem 27-17 for the complete 
story.) 


Prove that every natural number is either even or odd. 


Prove that if a set A of natural numbers contains mg and contains k + | 
whenever it contains k, then A contains all natural numbers > no. 


Prove the principle of mathenratical induction from the well-ordering prin- 

ciple. 

Prove the principle of complete induction from the ordinary principle of 

induction. Hint: If A contains | and A contains a+ 1 whenever it contains 

[coe n, consider the set B of all k such that 1,....k are all in A. 

(a) If a is rational and 6 is irrational, is a + b necessarily irrational? What 
if a and b are both irrational? 


13. 


14. 


15. 


16. 


ml 7. 
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(b) If a is rational and b is irrational, is ab necessarily irrational? (Careful!) 

(c)_ Is there a number a such that a? is irrational, but a? is rational? 

(d) Are there two irrational numbers whose sum and product are both ra- 
tional? 


(a) Prove that ve J5, and V6 are irrational. Hint: To treat V3, for exam- 
ple, use the fact that every integer is of the form 3” or 3n + 1 or 3n 42. 
Why doesn’t this proof work for V4? 

(b) Prove that V2 and ¥3 are irrational. 


Prove that 
(a) J/2 + V6 is irrational. 
(b) V2 + V3 is irrational. 


(a) Prove that if x = p+ /q where p and q are rational, and m is a natural 
number, then x” = a+ b,/q for some rational a and b. 
(b) Prove also that (p — /g)”" =a—b/q. 


f = te 9 9 
(a) Prove that if m and n are natural numbers and m*/n“ < 2, then 
3 is 
(m + 2n)-/(m +n)- > 2; show, moreover, that 
a) 9) 
(m + 2n)- Tg 
(m1 +7)< Tl 
(b) Prove the same results with all equality signs reversed. 
(c) Prove that if m/n < J/2, then there is another rational number m'/n' 
with m/n <m'/n' < V2. 


ft seems hkely that Jv is irrational whenever the natural number 1 is not 
the square of another natural number. Although the method of Problem 13 
may actually be used to treat any particular case, it is not clear in advance 
that it will always work, and a proof for the general case requires some extra 
information. A natural number p is called a prime number if it ts impos- 
sible to write p = ab for natural numbers a and b unless one of these is p, 
and the other 1; for convenience we also agree that | 1s not a prime number. 
‘Bhe firsigicwyprimenumbers are 2, 3,5; 7, 11, 13,97, 19. lf vn = lisnota 
prime, then 2 = ab, with a and b both < n; if either a or b is not a prime it 
can be factored similarly; continuing in this way proves that we can write 1 
as a product of primes. For example, 28 = 4-7 =2.-2.-7. 


(a) ‘Turn this argument into a rigorous proof by complete induction. (To 
be sure, any reasonable mathematician would accept the informal argu- 
ment, but this is partly because it would be obvious to her how to state 
it rigorously.) 


A fundamental theorem about integers, which we will not prove here, states 
that this factorization is unique, except for the order of the factors. ‘Thus, 
for example, 28 can never be written as a product of primes one of which 
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is 3, nor can it be written in a way that mvolves 2 only once (now you should 
appreciate why | is not allowed as a prime). 

‘ 0 cies : 5 
(b) Using this fact, prove that /7 is irrational unless n = m? for some natural 


number mm. 

(c) Prove more generally that (/7 is irrational unless n = m*, 

(d) No discussion of prime numbers should fail to allude to Euclid’s beautiful 
proof that there are infinitely many of them. Prove that there cannot be 
only finitely many prime numbers pj, p2, P3, --., Px by considering 


Pie P2-...* Px +l. 


*18. (a) Prove that if x satisfies 


! 


x" +a, 1x" +--+ ay = 0, 


for some integers dy—1,... , do, then x is irrational unless x is an integer. 
(Why is this a generalization of Problem 1] 7?) 
(b) Prove that J6 — V2 — V3 is irrational. 
: 3 fae: ‘ 5 : 
(c) Prove that V2 + V2 is irrational. Hint: Start by working out the first 6 
powers of this number. 
19. Prove Bernoulli’s inequality: If f > —1, then 


(l+h)" >1-+nh 


for any natural number n. Why 1s this trivial if 4 > 0? 


20. ‘The Fibonacci sequence a1, a2, a3, ... 1s defined as follows: 


eae — aU 
ee — Il, 
dy = @,—) + a for: => 3). 


‘This sequence, which begins 1, 1, 2, 3,5, 8, ... , was discovered by Fibonacct 
(circa 1175—1250), in connection with a problem about rabbits. Fibonacci 
assumed that an initial pair of rabbits gave birth to one new pair of rabbits 
per month, and that after two months each new pair behaved similarly. ‘The 
number a, of pairs born in the nth month is dy,—1 + d,—2, because a pair of 
rabbits is born for cach pair born the previous month, and moreover each 
pair born two months ago now gives birth to another pair. ‘The number of 
interesting results about this sequence is truly amazing— there is even a F1- 
bonacci Association which publishes a journal, The Ibonacer Quarterly. Prove 


that 
(ee Sa ay a 
oe rie Nea aan 


- 


ay = 


V5 


One way of deriving this astonishing formula is presented in Problem 24-16. 


2a 


apa 


2, 
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The Schwarz inequality (Problem 1-19) actually has a more general form: 


Give three proofs of this, analogous to the three proofs in Problem 1-19. 


The result in Problem 1-7 has an important generalization: If ay....,an > 0, 


then the “arithmetic mean” 


(@i| ap? OO SP Oly, 
n 
and “geometric mean” 
a ate. Om 
satisfy 
Gn = An 


(a) Suppose that ay < A,. Then some a; satisfies aj > Ay; for convenience, 
say a2 > A,. Let ay = A, and let a2 = a, +. a2 — a. Show that 


ajaz > a\ap. 


Why does repeating this process enough times eventually prove that G, < 
A,? (This is another place where it is a good exercise to provide a formal 
proof by induction, as well as an informal reason.) When does equality 
hold in the formula G,, < A,? 


The reasoning in this proof'is related to another interesting proof. 


< A, when n = 2, prove, by induction on k, that 


(b) Using the fact that G, 
G,) <eAgetor m= 2". 
(c) For a general n, let 2” >. Apply part (b) to the 2” numbers 


Gp cen Gree oon 


2” —n times 
to prove that Gy, < Ay. 


The following is a recursive definition of a”: 


] 


cma cd, 
al ae a. 
Prove, by duction, that 
eae — a au. 
(a) = (pfoee 


(Don't try to be fancy: use either induction on nv or induction on m, not both 


at once.) 
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24. Suppose we know properties Pl and P4 for the natural numbers, but that 
multiplication has never been mentioned. Then the followmg can be used 
as a recursive definition of multiplication: 


ee, eam 
(a+1)-b=a-b+b. 


Prove the following (in the order suggested)!): 


a:(b+c)=a-b+a-c (use induction on a), 
a-l—@e 
a-b=b-a (you just finished proving the case b = 1). 


25. In this chapter we began with the natural numbers and gradually built up to 
the real numbers. A completely rigorous discussion of this process requires 
a little book in itself (see Part V). No one has ever figured out how to get to 
the real numbers without going through this process, but if we do accept the 
real numbers as given, then the natural numbers can be defined as the real 
numbers of the form 1, 1+ 1, 1+1+1, ete. The whole point of this problem 
is to show that there is a rigorous mathematical way of saying “etc.” 


(a) A set A of real numbers is called inductive if 


(1) Llisin A, 
(2) k-+1 isin A whenever k is in A. 


Prove that 


i) Ris inductive. 
Gi) ‘The set of positive real numbers is inductive. 
(in) ‘The set of positive real numbers unequal to 5 is inductive. 
(iv) ‘The set of positive real numbers unequal to 5 is not inductive. 
(v) If A and B are inductive, then the set C of real numbers which 
are in both A and B is also inductive. 
(b) Areal number nv will be called a natural number if 7 is in every inductive 
Sc 


(i) Prove that | is a natural number. 
(ii) Prove that & + | is a natural number if k is a natural number. 


26. ‘There is a puzzle consisting of three spindles, with 7 concentric rings of 
decreasing diameter stacked on the first (Figure 1). A ring at the top of a 
stack may be moved from one spindle to another spindle, provided that it 
is not placed on top of a smaller ring, For example, if the smallest ring 1s 
moved to spindle 2 and the next-smallest ring is moved to spindle 3, then 
the smallest ring may be moved to spindle 3 also, on top of the next-smallest. 


Prove that the entire stack of n rmegs cau be moved onto spindle 3 in 2” — | 
FIGURE 1 moves, and that this cannot be done in fewer than 2" — | moves. 


- 


2. 
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University B. once boasted 17 tenured professors of mathematics. ‘Tradi- 
tion prescribed that at their weekly luncheon meeting, faithfully attended by 
all 17, any members who had discovered an error in their published work 
should make an announcement of this fact, and promptly resign. Such an an- 
nouncement had never actually been made, because no professor was aware 
of any errors in her or his work. This is not to say that no errors existed, 
however. In fact, over the years, in the work of every member of the de- 
partment at least one error had been found, by some other member of the 
department. ‘This error had been mentioned to all other members of the 
department, but the actual author of the error had been kept ignorant of the 
fact, to forestall any resignations. 

One fateful year, the department was augmented by a visitor from another 
university, one Prof: X, who had come with hopes of being offered a perma- 
nent position at the end of the academic year. Naturally, he was apprised, by 
various members of the department, of the published errors which had been 
discovered. When the hoped-for appointment failed to materialize, Prof: X 
obtained his revenge at the last luncheon of the year. “Thave enjoyed my visit 
here very much,” he said, “but I feel that there is one thing that I have to tell 
you. At least one of you has published an incorrect result, which has been 
discovered by others in the department.” What happened the next year? 


After figuring out, or looking up, the answer to Problem 27, consider the fol- 
lowing: Each member of the department already knew what Prof. X asserted, 
so how could his saying it change anything? 
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PART 9) 


FOUNDATIONS 


The statement is so frequently made 
that the differential calculus deals with 
continuous magnitude, and yet 

an explanation of this continuaty is 
nowhere given; 

even the most rigorous expositions 

of the differential calculus do not base 
their proofs upon continuity but, 

with more or less consciousness of the fact, 
they either appeal to geometric notions 
or those suggested by geometry, 

or depend upon theorems which are never 
established in a purely arithmetic manner. 
Among these, for example, 

belongs the above-mentioned theorem, 
and a more careful investigation 
convinced me that this theorem, or 

any one equivalent to it, can be regarded 
in some way as a sufficient basis 

for infinitesimal analysis. 

It then only remained to discover its true 
origin in the elements of arithmetic 

and thus at the same time 

to secure a real definition of 

the essence of continuity. 

I succeeded Nov. 24, 1858, and 

a few days afterward I communicated 
the results 

of my meditations to my dear friend 
Durége with whom I had a long 

and hively discussion. 


RICHARD DEDEKIND 


CHAPTER 


PROVISIONAL DEFINITION 


FUNCTIONS 


Undoubtedly the most important concept in all of mathematics is that of a 
function in almost every branch of modern mathematics functions turn out to 
be the central objects of investigation. It will therefore probably not surprise you 
to learn that the concept of a function is one of great generality. Perhaps it will 
be a rehef to learn that, for the present, we will be able to restrict our attention to 
functions of a very special kind; even this small class of functions will exhibit sufh- 
cient variety to engage our attention for quite some time. We will not even begin 
with a proper definition. For the moment a provisional definition will enable us to 
discuss functions at length, and will illustrate the intuitive notion of functions, as 
understood by mathematicians. Later, we will consider and discuss the advantages 
of the modern mathematical defimtion. Let us therefore begin with the followme: 


A function 1s a rule which assigns, to each of certam real numbers, some other real 


number. 


The followmg examples of functions are meant to illustrate and amplify this defi- 
nition, which, admittedly, requires some such clarification, 


Example 1 The rule which assigns to each number the square of that number. 


Example 2. ‘The rule which assigns to each number y the number 


yer oy 
Pg i 


Example 5 ‘The rule which assigns to each number c 4 1, —1 the number 


o+3c+5 


c2 — | 


Example 4 ‘The rule which assigns to each number x satisfying —17 < x < 2/3 
the number x7. 

Example 5 ‘The rule which assigns to each number a the number 0 if @ is 
irrational, and the number | if @ is rational. 


Example 6 ‘The rule which assigns 


to 2 the number 5, 
36 

to 17 the number —, 
X 
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a] 


4 
to 7 the number 28, 


36 
to — the number 28, 
is 


and to any y #2, 17, 27/17, or 36/z, the number 16 if y is of the form a+ b/2 
fora, bin Q. 

Example 7 The rule which assigns to each number ¢ the number ¢* +x. (This 
rule depends, of course, on what the number x is, so we are really describing 
infinitely many different functions, one for each number x.) 

Example 8 “Vhe rule which assigns to each number < the number of 7’s in the 
decimal expansion of z, if this number is finite, and —z ifthere are infinitely many 
7’s in the decimal expansion of <. 


One thing should be abundantly clear from these examples a function is ay 
rule that assigns numbers to certain other numbers, not just a rule which can 
be expressed by an algebraic formula, or even by one uniform condition which 
apples to every number; nor is it necessarily a rule which you, or anybody else, 
can actually apply in practice (no one knows, for example, what rule 8 associates 
to wz). Moreover, the rule may neglect some numbers and it may not even be clear 
to which numbers the function applies (try to determine, for example, whether the 
function in Example 6 applies to z). ‘The set of numbers to which a function does 
apply is called the domaim of the function. 

Before saying anything else about functions we badly need some notation. Since 
throughout this book we shall frequently be talking about functions (indeed we shall 
hardly ever talk about anything else) we need a convenient way of naming func- 
tions, and of referring to functions in general. The standard practice is to denote 
a function by a letter. For obvious reasons the letter “f™ is a favorite, thereby 
“g™ and “h” other obvious candidates, but any letter (or any reasonable 
x” and “y”, although these letters 


making 
symbol, for that matter) will do, not excluding * 
are usually reserved for indicating numbers. If f is a function, then the number 
which f associates to a number x 1s denoted by f(x) this symbol is read “f of 
x” and is often called the value of f at x. Naturally, if we denote a function by x, 
some other letter must be chosen to denote the number (a perfectly legitimate, 
though perverse, choice would be “f,” leading to the symbol x(f)). Note that the 
symbol f(x) makes sense only for x m the domain of f; for other x the symbol 
f(x) is not defined. 

If the functions defined in Examples 1-8 are denoted by f, g, 4, r, 5, 0, ax, 
and y, then we can rewrite their definitions as follows: 


(1) f(x) =8r2® “for alll x! 
tL te 
(2) g()= wa? for all y. 
3 
~4+3e4+5  . 
(3G = ae for all c = |. —1. 
c* — 
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(4) r(x) =x? for all x such that —17 <x < 7/3. 


CEC) = | Q, x irrational 


ll fe rational: 


3, e— 2 
36 
—. x=17 
INE 
12 
(6) oxy)= 4 28 = iz 
36 
o> r= — 
Iv 


4 


IU 
(6 oe ae 
ate T. 


Oe oa) = r+x forall numbers rf. 


36 
or —, and x =a+bVvV?2 fora,bin Q. 
1 


(8) y(x) n, exactly 1 7’s appear in the decimal expansion of x 
yO ey j ; ; : 
( —7, infinitely many 7’s appear in the decimal expansion of x. 


These definitions illustrate the common procedure adopted for defining a func- 
tion f—indicating what f(x) is for every number x in the domain of f. (Notice 
that this is exactly the same as indicating f(a) for every number a, or f(b) for ev- 
ery number J, etc.) In practice, certain abbreviations are tolerated. Definition (1) 
could be written simple 


CR fOr) =ex7 


the qualifying phrase “for all +” being understood. Of course, for definition (4) 
the only possible abbreviation is 


Ces Ss", —l7 <x <27/3. 


It is usually understood that a definition such as 


| | 
k(xyS—+——, x #0.1 
Ge 


x 


can be shortened to 


l 1 
kK(x)=-—+ 


x x-—1 


in other words, wiless the domain is explicitly restricted further, it is understood to consist of 
all numbers for which the definition makes any sense at all. 


You should have little difficulty checking the following assertions about the fune- 
tions defined above: 


Fh) = p@) aera: 
2G) = Fe Sag? ST Cy 
raxtl=rw)+2x4+ lif -lI7<x«< = — |; 
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s(x + y) =s(x) if y is rational: 


fx? ; (= 
g{— Ad{—]; 
be Nv 


x-[f@)+1]; 


a.) 


IS 
2 | Sy 
Ne 

| 

S 
a 
o| ~ 
ens 

II 

| 

aS 


Ifthe expression f (s(a)) looks unreasonable to you, then you are forgetting that 
s(a) is a number hke any other number, so that f(s(a)) makes sense. As a matter 
of fact, f(s(a)) = s(a) for all a. Why? Even more complicated expressions than 
f(s(a)) are, afier a first exposure, no more difficult to unravel. ‘The expression 


f(r (s(8(a3(y(4)))))), 
formidable as it appears, may be evaluated quite easily with a little patience: 


f(r (s(O(a3(y(4)))))) 
= f (r(s(6(a3(0))))) 
ay (rs (7(3)))) 
= f(r(s(16))) 
= f(r()) 
fd) 
=|, 


The first few problems at the end of this chapter give further practice manipulating 
this symbolism. 

The function defined in (1) is a rather special example of an extremely impor- 
tant class of functions, the polynomial functions. A function f is a polynomial 
function if there are real numbers do, ... , d, such that 


1 


= 3) Fe 
f(X) = ay x" + yy x" +s Fagx” + ayx tag, for all x 


(when f(x) is written in this form it is usually tacitly assumed that a, 4 0). The 
highest power of x with a nonzero coefficient is called the degree of f; for 
example, the polynomial function f defined by f(x) = 5x® + 137x+ — 7 has 
degree 6. 

The functions defined in (2) and (3) belong to a somewhat larger class of func- 
tions, the rational functions; these are the functions of the form p/q where p 
and q are polynomial functions (and g is not the function which is always 0). ‘The 
rational functions are themselves quite special examples of an even larger class of 
functions, very thoroughly studied in calculus, which are simpler than many of the 
functions first mentioned in this chapter. ‘Vhe following are examples of this kind 
of function: 

x +x24xsin? x 
7 OO = ——— 
Xisii@ Sf A SIN” eh 
(10) f(x) = sin(x?). 
(11) f(x) = sin(sin(x?)). 
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12) jeer sin? (sin (sin? (x sin? x’))) - sin (eee), 


x - sin % 


By what criterion, you may feel impelled to ask, can such functions, especially a 
monstrosity like (12), be considered simple? The answer is that they can be built 
up from a few simple functions using a few simple means of combining functions. 
In order to construct the functions (9)-(12) we need to start with the “identity 
function” J, for which J(x) = x, and the “sine function” sin, whose value sin(x) at 
x is often written simple sin.x. The following are some of the important ways in 
which functions may be combined to produce new functions. 

If f and g are any two functions, we can define a new function f + g, called 
the sum of f and g, by the equation 


C2) —) OC eu 


Note that according to the conventions we have adopted, the domain of f + g 
consists of all x for which “f(x*) + g(x)” makes sense, te., the set of all x in both 
domain f and domain g. If A and B are any two sets, then AN B (read “A 
intersect B” or “the intersection of A and B”) denotes the set of x m both A 
and B; this notation allows us to write domain(f + g) = domain f M1 domain g. 


In a similar vein, we define the product f - g and the quotient f (or f/g) of 
f and g by 
Ci tevin) — (2) e) 


£) ml ¥@) 
(2 a 5 g(x) 


Moreover, if g is a function and c is a number, we define a new function c - g by 


and 


(eo) (%) = c- 2(X). 


This becomes a special case of the notation f - g if we agree that the symbol c 
should also represent the function f defined by f(x) = c; such a function, which 
has the same value for all numbers x, is called a constant function. 

The domain of f - g 1s domain f M domain g, and the domain of c- g is simply 
the domain of g. On the other hand, the domain of f/g is rather complicated — it 
may be written domain f 1 domain gM {x : g(v) 4 O}, the symbol {x : g(x) 4 0} 
denoting the set of numbers x such that g(x) 4 0. In general, {x : ...} denotes 
the set of all x such that “ ...” is true. Thus {x : x? +3 < 11} denotes the set of 
all numbers x such that x* < 8, and consequently {x :.x3+3 < 11} = {w:x <2}. 
Either of these symbols could just as well have been written using y everywhere 
iustead of x. Variations of this notation are common, but hardly require any 
discussion, Any one can guess that {x > 0: x3 < 8} denotes the set of positive 
numbers whose cube is less than 8; it could be expressed more formally as {x : 
x > O and x? < 8}. Incidentally, this set is equal to the set {x :0 <x < 2}. One 
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variation is slightly less transparent, but very standard. he set {1, 3,2, 4}, for 
example, contains just the four numbers 1, 2, 3, and 4; it can also be denoted by 
[oe oe = lor x. =sbor i= Zor -e= 4). 

Certain facts about the sum, product, and quotient of functions are obvious con- 
sequences of facts about sums, products, and quotients of numbers. For example, 
it is very easy to prove that 


(f+g)th=ft+(gt+h). 


The proof is characteristic of almost every proof which demonstrates that two 
functions are equal —the two functions must be shown to have the same domain, 
and the same value at any number in the domain. For example, to prove that 
(f+g)th= f+(g+h), note that unraveling the definition of the two sides gives 


(Cf £2) il Gs en aL esr 
[f@) + g@)] FRG) 


and 


[f(g thx) = f(x) + (g +A)(X) 
= a ee) ie CO) 


and the equality of [ f(x) + g(x)| +A) and f(x) + [ g(x) +A(x)] isa fact about 
numbers. In this proof the equality of the two domains was not exphcitly men- 
tioned because this is obvious, as soon as we begin to write down these equations; 
the domain of (f +g) +h and of f + (g +/) is clearly domain f NM domain g N 
domain. We naturally write f +g +h for (f +g) +4 = f +(g +A), precisely 
as we did for numbers. 

It is Just as easy to prove that (f+ g)-h = f-(g-/), and this function 1s denoted 
by f-g-h. The equations f+ ¢ = g+ f and f-g =g- f should also present 
no difficulty. 

Using the operations +, -, / we can now express the function f defined in (9) 
by 

P-+i-i+]7-sm-sin 


J sim --/ -sin-sm 


It should be clear, however, that we cannot express function (10) this way. We re- 
quire yet another way of combining functions. ‘This combination, the composition 
of two functions, is by far the most important. 

If f and g are any two functions, we define a new function fo g, the compo- 
sition of f and g, by 


the domain of fog is {x : x is in domain g and g(x) is in domain f}. ‘Vhe symbol 
“fog” is often read “f circle g.” Compared to the phrase “the coniposition of f 
and g” this has the advantage of brevity, of course, but there is another advantage 
of far greater import: there is much less chance of confusing fo g with go f, aud 
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these must not be confused, since they are not usually equal; in fact, almost any f 
and g chosen at random will illustrate this point (try f = /-/ and g = sin, for 
example). Lest you become too apprehensive about the operation of composition, 
let us hasten to point out that composition 7s associative: 


(fog)oh= f o(goh) 


(and the proof is a triviality); this function 1s denoted by fo g oh. We can now 
write the functions (10), (11), (12) as 

Of =sin od «7 1 

sm osinic (ry 

(12) f = (sin- sin) osin o (sin- sin) o (/ - [(sin- sin) o (/ - /)]) - 


: i. sino (sin) 
sin o { —————____— _ }}. 
7+sin 


One fact has probably already become clear. Although this method of writing 
functions reveals their “structure” very clearly, it is hardly short or convenient. ‘The 
shortest name for the function f such that f(x) = sin(x’) for all x unfortunately 
seems to be “the function’ 7 such that ~(@).= sin(x7) for all x.” The need for 
abbreviating this clumsy description has been clear for two hundred years, but no 
reasonable abbreviation has received universal acclaim. At present the strongest 
contender for this honor is something like 


° 9 
x => sin(x*) 


(read “x goes to sin(x*)” or just “x arrow sin(x7)”), but it is hardly popular among 
writers of calculus textbooks. In this book we will tolerate a certain amount of 
ellipsis, and speak of “the function f(x) = sin(x?).” Even more popular is the 
quite drastic abbreviation: “the function sin(x7).” For the sake of precision we 
will never use this description, which, strictly speaking, confuses a number and 
a function, but it is so convenient that you will probably end up adopting it for 
personal use. As with any convention, utility is the motivating factor, and this 
criterion ts reasonable so long as the slight logical deficiencies cause no confusion. 
On occasion, confusion wil arise unless a more precise description is used. For 
example, “the function x +” is an ambiguous phrase; it could mean either 


x > x+t°,ie., the function f such that f(x) =x +P? for all x 


or 


t > x +1°,ice., the function f such that f(t)=x +P for allt. 


As we shall see, however, for many mmportant concepts associated with functions, 
calculus has a notation which contains the “x +” built in. 

By now we have made a sufhiciently extensive investigation of functions to war- 
rant reconsidering our definition. We have defined a function as a “rule,” but it is 
hardly clear what this means. If we ask “What happens if you break this rule?” it 
is not easy to say whether this question is merely facetious or actually profound. 
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A more substantial objection to the use of the word “rule” is that 


D . 


Lee) = 
and 


f Cc) ee Oe = eal) 


are certainly different rules, if by a rule we mean the actual instructions given for 
determining f(x); nevertheless, we want 


fx) =x? 
and 


(AC) — x 3m to ae ee 1) 


to define the same function. For this reason, a function is sometimes defined as an 
“association” between numbers; unfortunately the word “association” escapes the 
objections raised against “rule” only because it is even more vague. 

There is, of course, a satisfactory way of defining functions, or we should never 
have gone to the trouble of criticizing our original definition. But a satisfactory 
definition can never be constructed by finding synonyms for English words which 
are troublesome. ‘The definition which mathematicians have finally accepted for 
“function” is a beautiful example of the means by which intuitive ideas have been 
incorporated into rigorous mathematics. The correct question to ask about a 
function is not “What is a rule?” or “What is an association?” but “What does 
one have to know about a function in order to know all about it?” ‘The answer to 
the last question 1s easy-- for each number x one needs to know the number / (x); 
we can imagine a table which would display all the information one could desire 
about the function f(x) = x?: 


x iAee) 

l 

—| l 
2 4 
—2 4 
2 


It is not even necessary to arrange the numbers m a table (which would actually 
be impossible if we wanted to list all of them). Instead of a two column array we 


can consider various pairs of numbers 


Ci), Cll), (g4) 2, 4), er 77), 2, 2) 


DEFINITION 


DEFINITION 
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simply collected together into a set.* ‘lo find f(1) we simply take the second 
number of the pair whose first member is 1; to find f(z) we take the second 
number of the pair whose first member is 7. We seem to be saying that a function 
might as well be defined as a collection of pairs of numbers. For example, if we 
were given the following collection (which contains just 5 pairs): 


i =ihelcs] (Geet ce( Sed) oe (4098), (SH4 IE 
then of (lyf GC) =7, 7 2) =o, a) — 6, eo) = 4 and IB 3.4.5, Siane the 


only numbers in the domain of f. If we consider the collection 
PE Oy 1) 2). 8); 485 4), 


then f(3) = 7, f(2) =5, f(8) = 4; but it is impossible to decide whether f(1) = 7 
or f(1) = 8. In other words, a function cannot be defined to be any old collection 
of pairs of numbers; we must rule out the possibility which arose in this case. We 
are therefore led to the following defimition. 


A function is a collection of pairs of numbers with the followmg property: if 


(a, b) and.(a,c).are both, ms» th¢-collegtion then.) =.«c; mother svords, the 
collection must not contain two different pairs with the same first element. 


This is our first full-fledged definition, and illustrates the format we shall always 
use to define significant new concepts. ‘These definitions are so important (at 
least as important as theorems) that it is essential to know when one is actually 
at hand, and to distinguish them from comments, motivating remarks, and casual 
explanations. ‘Vhey will be preceded by the word DEFINITION, contain the term 
being defined in boldface letters, and constitute a paragraph unto theinselves. 

There is one more definition (actually defining two things at once) which can 
now be made rigorously: 


If f is a function, the domain of / is the set of all a for which there is some b 
such that (a,b) isin f. If ais in the domain of f, it follows from the definition 


of a function that there is, in fact, a unique number b such that (a,b) is in f. 
This unique b is denoted by f(a). 


With this definition we have reached our goal: the important thing about a 
function f is that a number f(x) is determined for each number x in its domain. 
You may feel that we have also reached the pomt where an intuitive definition has 
been replaced by an abstraction with which the mind can hardly grapple. ‘Two 
consolations may be offered. First, although a function has been defined as a 


* The pairs occurring here are often called “ordered pairs,” to emphasize that, for example, (2, 4) is 
not the same pair as (4, 2). It is only fair to warn that we are going to define functions in terms of 
ordered pairs, another undefined term. Ordered pairs can be defined, however, and an appendix to 
this chapter has been provided for skeptics. 
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collection of pairs, there is nothing to stop you from thinking of a function as a 
rule. Second, neither the intuitive nor the formal definition indicates the best way 
of thinking about functions. ‘Che best way is to draw picturcs; but this requires a 
chapter all by itself: 


PROBLEMS 
Le plicten() — V/()-- x). Vehatis 


Gi) ff (x)) (for which x does this make sense?). 


ii) =f (cx). 

iv) f(x+y). 

)  fix)+ fo). 

n) _Vowsavihich numbers,ems there a mumber « such that _f(cx) = f(x). 
Hint: ‘Vhere are a lot more than you might think at first glance. 

(vu) For which numbers c is it true that f(cx) = f(x) for two different 

numbers x? 


2. Let g(x) =x’, and let 


0, x rational 
|, x itrational: 


iio = 


(3) For which y is h(y) < y? 
(i) For which y is h(y) < g(y)? 
(iii) What is g(h(z)) — A(z)? 

( 

( 


iv) For which w is g(w) < w? 
v) kor which ¢ is g(g(€)) = g(e)? 


3. Find the domain of the functions defined by the following formulas. 
(i) fj Gea l= x7. 


(i) f@) =V1—- V1 —2?. 


be: l ] 
(111) A) 


avy) = —w | — fy ee ele 
(Vv) f@)=Vl—-x4+vx-2. 


ay Z i . ye ~ ~ * 
4. LetS@y=x~, let P(x) = 2 and let s(@)i= sine ind Rach othe tollowine: 
In each case you answer should be a number. 


(1), geuiSuawi2)(wy ). 

Gi) mGSeGy)s 

(ii) (So Pos)(t)+(so P)Q). 
(iVieensi(e): 


5. Express each of the following functions in terms of SP. 9s, use only 
+, +, and o (for example, the answer to (1) is Pos). In each case your 
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answer should be a_funetion. 


i) 
il) 
i) 
iv) 


v) 


( 
(il 
(11 
( 
( 

(vi) 
(vil) 


f(x) = Qsine 

(Qasim. 

f(x) = sinx?. 

f(x) = sin? x (remember that sin? x is an abbreviation for (sin.x)?). 
f(t) = 27. (Note: a” always means a; this convention is adopted 
because (a”)° can be written more simply as a.) 


f(u) = sin(2" +2"), 
(Ae = sin(sin (sin (2? 


9sin y 


))). 


(vill) f(a) Ss ee crea en a 


Polynomial functions, because they are simple, yet flexible, occupy a favored 


role in most investigations of functions. The following two problems illustrate their 


flexibility, and guide you through a derivation of their most tmportant elementary 


properties. 


6. 


(a) 


(b) 


If xy, ..., X%, are distinct numbers, find a polynomial function fj; of 
degree u — | which ts 1 at x; and O at x; for j Ai. Hint: the product of 
all (x — x;) for j Ai, is O at x; if j Ai. (This product is usually denoted 


by 
n 


[[@ Ee 


v= 

hae 
the symbol M1 (capital pi) playing the same role for products that & plays 
for sums.) 
Now find a polynomial function f of degree un — 1 such that f(x) = aj, 
where aj, ..., G are given numbers. (You should use the functions 
f; from part (a). The formula you will obtain is called the “Lagrange 
interpolation formula.”) 


Prove that for airy polynomial function f, and any number a, there is a 
polynomial function g, and a number b, such that f(x) = (v¥—a)g(x) +b 
for all x. (The idea is simply to divide (x ~ a) mto f(x) by long division, 
until a constant remainder is left. For example, the calculation 


4 


x- +x —2 
x—l )x3 —3x+1 
x —x? 


x? —3x 
a) 
x —Xx 
—2x+1 
—2x +2 
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shows that x7 — 3x + 1 = (w — 1)? +x — 2)— 1. A formal proof is 
possible by induction on the degree of f.) 

(b) Prove that if f(a) = 0, then f(x) = (« — a)g(x) for some polynomial 
function g. (The converse is obvious.) 

(c) Prove that if f ts a polynomial function of degree n, then f has at most 
n roots, 1.e., there are at most 2 numbers a with f(a) = 0. 

(d) Show that for each n there is a polynomial function of degree n with 
n roots. If nis even find a polynomial function of degree n with no 
roots, and if n is odd find one with only one root. 


8. For which numbers a, b, c, and d will the function 


ax +b 

(x) = ——— 
f cx+d 

satisfy f(f(x)) =x for all x (for which this equation makes sense)? 

9. (a) If A ts any set of real numbers, define a function Cy, as follows: 


fe sana 


ee: Vox QO, x notin A. 


Find expressions for Cang and Caug and Cr—a, in terms of C4 and Cz. 
(The symbol AQ B was defined in this chapter, but the other two may 
be new to you. ‘They can be defined as follows: 


ALJ i= a -1s In Alor «4 isin 
R— A = {x : x is in R but x 1s not in A}.) 
(b) Suppose f is a function such that f(x) = 0 or | for each x. Prove that 
tiete issassct A sliclhthat 7 = Cy. 
(c) Show that f = f? if and only if f = C4 for some set A. 
10. (a) For which functions f is there a function g such that f = g*? Hint: You 
can certainly answer this question if “function” is replaced by “number.” 
(b) For which functions f is there a function g such that f = 1/g? 
*(c) For which functions b and ¢ can we find a function x such that 


(x(t)? + D(x (t) + c(t) = 0 


for all numbers ¢ ? 
*(d) What conditions must the functions a and b satisfy if there ts to be a 
function x such that 
a(t)x(t) + b(t) =0 

for all numbers ¢? How mauy such functions x will there be? 

11. (a) Suppose that H is a function and y is a number such that H(H(y)) = y. 
What ts 

HCH CH (+: (H@)---)8 


80 tines 


12. 


el. 


14. 


15. 


*16. 
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(b) Same question if 80 is replaced by 81. 
(c) Same question if H(H(y)) = H()y). 

*(d) Find a function H such that H(H(x)) = H(x) for all numbers x, and 
Such. Ladtedu— 30.2) — 7/3. HS) =e BiOOre = 0mEl En) 3) — 
1/3, H(47) = 47. (Don't try to “solve” for H(x); there are many func- 
tions H with H(H(x)) = H(x). The extra conditions on H are supposed 
to suggest a way of finding a suitable H.) 

*(e) Find a function H such that H(A (x)) = H(x) for all x, and such that 
(ehOW Th feubl/)) Solis. 


A function f is even if f(x) = f(—x) and odd if f(x) = —f(—x). For 
example, f is even if f(x) = x? or f(x) = |x| or f(x) = cosx, while f is 
odd if {(-) = xsor sGe) =ssy. 


(a) Determine whether f + g is even, odd, or not necessarily either, in the 
four cases obtained by choosing f even or odd, and g even or odd. (Your 
answers can most conveniently be displayed in a 2 x 2 table.) 

(b) Do the same for f - g. 

(c) Do the same for f 0 g. 

(d) Prove that every even function f can be written f(x) = g(|x|), for in- 
finitely many functions g. 


(a) Prove that any function f with domain R can be written f = E + O, 
where E is even and O is odd. 

(b) Prove that this way of writing f is unique. (If you try to do part (b) first, 
by “solving” for E and O you will probably find the solution to part (a).) 


If f is any function, define a new function |f| by |fl(x) = |f@)|. If f 
and g are functions, define two new functions, max(f, g) and min(f, g), by 


MAN) eC. aK 7%). 20L)), 
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Find an expression for max(f. g) and mim(f. g) in terms of | |. 


(a) Show that f = max(f,0) + min(f,0). This particular way of writing 
f is fairly useful; the functions max(f.0) and min(f,0) are called the 
positive and negative parts of f/f. 

(b) A function f is called nonnegative if f(x) > 0 for all x. Prove that any 
function f can be written f = g — h, where g and h are nonnegative, 
in infinitely many ways. (The “standard way” is g = max(f, 0) and h = 
—min(f, 0).) Hint: Any nanber can certainly be written as the difference 
of two nonnegative numbers in infinitely many ways. 


Suppose f satisfies f(x + y) = f(x) + f() for all x and y. 

(a) Prove that f(x) +-->+4n) = frp) +--+ fOr). 

(b) Prove that there is some number c¢ such that f(x) = cx for all rational 
numbers x (at this point we’re not trying to say anything about f(x) for 
irrational x). Hint: First figure out what c must be. Now prove that 
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f(x) = ex, first when x is a natural number, then when x is an integer, 
then when x is the reciprocal of an integer and, finally, for all rational x. 


If f(x) =0 for all x, then f satisfies f(x + y) = f(x)+ f(y) for all x and y, 
and also f(x-y) = f(x)- f(y) for all x and y. Now suppose that f satisfies 
these two properties, but that f(x) is not always 0. Prove that f(+) = x for 


all x, as follows: 


Prove that f(1) =1. 

Prove that f() =~ if x is rational. 

Prove that f(x) > Oif x > 0. (This part is tricky, but if you have 
been paying attention to the philosophical remarks accompanying the 
problems in the last two chapters, you will know what to do.) 

Prove. that f (& )t> ey (Ml ry. 

Prove that f(x) = x for all x. Hint: Use the fact that between any two 
numbers there is a rational number. 


Precisely what conditions must f, g, 4, and k satisfy in order that f(x)g(y) = 
h(x)k(y) for all x and y? 


(a) 


Prove that there do no¢ exist functions f and g with either of the followmg 
propertics: 

Gi) f(x) +g8(y) = xy for all x and y. 

(ey oe ety) = x rior allisanday: 

Hint: ‘Try to get some information about f or g by choosing particular 
values of x and y. 

Find functions f and g such that f(x + y) = g(xy) for all x and y. 


Find a function f, other than a constant function, such that | f(y) — 
==) — x|: 

Suppose that f(y) — f(x) < (y — x)? for all x and y. (Why does this 
imply that | f(y) — f(x)| < (v—x)*?) Prove that f is a constant function. 
Hint: Divide the interval from x to y into n equal pieces. 


Prove or give a counterexample for each of the following assertions: 


fo(gt+th)= fogt+foh. 
(g+hyoy —goftho f. 
I | 


j . oe in 


co() 
(ey 


Suppose g =71 o f. sProve thatil’ f/@)= f(y), theng@) =e): 
Conversely, suppose that f and g are two functions such that g(v) = g(y) 
whenever f(x) = f(y). Prove that g =/o f for some function /. Hint: 


Just try to define A(z) when z is of the form z = f(x) (these are the only ¢ 


that matter) and use the hypotheses to show that your definition will not 


run imto trouble. 
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Suppose that fo g = J, where /(x) =x. Prove that 


a) Meee” Vy ethene (x oo clave 


b) every number b can be written b = f(a) for some number a. 


a) Suppose g is a function with the property that g(x) 4 g(y) if x F y. 
Prove that there is a function f such that fog =/. 

b) Suppose that f is a function such that every number b can be written 
b = f(a) for some number a. Prove that there is a function g such that 
fog=l. 


Find a function f such that go f = / for some g, but such that there is no 
function A with f oh =T. 


Suppose f o ge= leancdyeo fol. Prove that g = h. Hint: Use the tet that 
composition 1s associative. 


(a) Suppose f(x) = x+1. Are there any functions g such that fog = go f? 

(b) Suppose f is a constant function. For which functions g does fo g = 
Fasie| 

(c) Suppose that fog = g° f for all functions g. Show that f is the identity 
fimetion, f(x. 


(a) Let F be the set of all functions whose domain is R. Prove that, using + 
and - as defined in this chapter, all of properties P1- P9 except P7 hold 
for F, provided 0 and I are interpreted as constant functions. 

(b) Show that P7 does not hold. 

*(c) Show that PI1O-P12 cannot hold. In other words, show that there is 
no collection P of functions in F, such that PIO-P12 hold for P. (It is 
sufficient, and will simplify things, to consider only functions which are 0 
except at two points x9 and .x}.) 

(d) Suppose we define f < g to mean that f(x) < g(x) for all x. Which of 
P’10- P’I3 (in Problem 1-8) now hold? 

(e) gli of =< Suis oe Rs f Oh < go} F 
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APPENDIX. ORDERED PAIRS 


Not only in the definition of a function, but in other parts of the book as well, 
it is necessary to use the notion of an ordered pair of objects. A definition has 
not yet been given, and we have never even stated explicitly what properties an 
ordered pair is supposed to have. ‘The one property which we will require states 
formally that the ordered pair (a,b) should be determined by a and b, and the 
order in which they are given: 


it (a, &) = (c,d), then.a = c and — 4. 


Ordered pairs may be treated most conveniently by simply introducing (a, b) 
as an undefined term and adopting the basic property as an axiom—since this 
property is the only significant fact about ordered pairs, there is not much point 
worrying about what an ordered pair “really” is. ‘Those who find this treatment 
satisfactory need read no further. 

The rest of this short appendix is for the benefit of those readers who will feel 
uncomfortable unless ordered pairs are somehow defined so that this basic property 
becomes a theorem. ‘There is no point in restricting our attention to ordered pairs 
of numbers; it 1s just as reasonable, and just as important, to have available the 
notion of an ordered pair of any two mathematical objects. ‘This means that our 
definition ought to involve only concepts common to all branches of mathematics. 
The one common concept which pervades all areas of mathematics is that of a 
set, and ordered pairs (like everything else in mathematics) can be defined in this 
context; an ordered pair will turn out to be a set of a rather special sort. 

The set {a, b}, containing the two elements a and b, is an obvious first choice, 
but will not do as a definition for (a,b), because there is no way of determining 
from {a,b} which of a or b is meant to be the first element. A more promising 
candidate is the rather startling set: 


{ {a}. {a, b}}. 


This set has two members, both of which are themselves sets; one member is the set 
{a}, containing the single member a, the other is the set {a, b}. Shocking as it may 
seem, we are going to define (a, b) to be this set. he justification for this choice 1s 
given by the theorem immediately following the definition- the definition works, 
and there really isn’t anything else worth saying. 


(a, b) = (la). [aso 


If (a2b) = (<4), thema= c-and b= d, 


‘The hypothesis means that 
{ {a}, fa, b}} = {fe}, {c, a} }. 


Now { {a}, {a, b}} contains just two members, {a} and {a,b}: and a is the only 
common element of these two members of { {a}, {a,b} }. Similarly, ¢ is the unique 
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common member of both members of {{c}, {c,d}}. Therefore a = c. We there- 
fore have 
{{a}, {a,b} } = { {a}, {a,d}}, 


and only the proof that b = d remains. It is convenient to distinguish 2 cases. 


Case 1. b =a. In this case, {a, b} = {a}, so the set { {a}, {a, b}} really has only one 
member, namely, {a}. The same must be true of { {a}, {a,d}}, so {a,d} = {a}, 
which imphes that d = a = b. 


Case 2. b # a. In this case, b is in one member of { {a}, {a,b}} but not in the 
other. It must therefore be true that b is in one member of { {a}, {a,d}} but not 
in the other. This can happen only if b is in {a, d}, but b is not in {a}; thus b= a 
on b =d, but. b'Aacsobl—a. a 


= 0 
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Mention the real numbers to a mathematician and the image ofa straight Ime will 
probably form in her mind, quite involuntarily. And most likely she will neither 
banish nor too eagerly embrace this mental picture of the real numbers. “Geomet- 
ric intuition” will allow her to mterpret statements about numbers in terms of this 
picture, and may even suggest methods of proving them. Although the properties 
of the real numbers which were studied in Part I are not greatly illuminated by a 
geometric picture, such an interpretation will be a great aid in Part II. 

You are probably already famihar with the conventional method of considering 
the straight line as a picture of the real numbers, 1.e., of associating to each real 
number a point on a line. ‘To do this (Figure 1) we pick, arbitrarily, a pomt which 
we label 0, and a point to the right, which we label 1. ‘The point twice as far to 
the right is labeled 2, the point the same distance from 0 to I, but to the left of 0, 
is labeled —1, ete. With this arrangement, if a < b, then the point corresponding 
to a hes to the left of the point corresponding to b. We can also draw rational 
numbers, such as 5, in the obvious way. It is usually taken for granted that the 
irrational numbers also somehow fit into this scheme, so that every real number 
can be drawn as a point on the line. We will not make too much fuss about 


justifying this assumption, since this method of “drawing” numbers is intended 


solely as a method of picturing certain abstract ideas, and our proofs will never 
rely on these pictures (although we will frequently use a picture to suggest or help 
expla a proof). Because this geometric picture plays such a prominent, albeit 
inessential role, geometric terminology is frequently employed when speaking of 
numbers thus a number is sometimes called a pomt, and R is often called the 
real line. 

The number |a—)| has a simple interpretation m terms of this geometric picture: 
itis the distance between a and b, the length of the line segment which has @ as one 
end pomt and 6 as the other. ‘This means, to choose an example whose frequent 
occurrence justifies special consideration, that the set of numbers x which satisfy 
|x — a| < € may be pictured as the collection of pomts whose distance from a is 
less than e. This set of points is the “interval” from a — € to a+ €, which may also 
be deseribed as the pomts corresponding to numbers x with a —€ <* <a+e 
(Figure 2). 

Sets of numbers which correspond to intervals arise so frequently that it is desir- 
able to have special names for them. ‘The set {x 1a <x < b} 1s denoted by (a, b) 
and called the open interval from a to b. ‘This notation naturally creates some 
ambiguity, since (a, b) is also used to denote a pair of numbers, but in context it 1s 
always clear (or can easily be made clear) whether one is talking about a pair or 
an interval. Note that if a > b, then (a, b) = ¥, the set with no clements; in prac- 
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tice, however, it is almost always assumed (explicitly if one has been careful, and 
implicitly otherwise), that whenever an interval (a, b) is mentioned, the number a 
is less than b. 


The set {v : a <x < b} is denoted by [a, | and is called the closed interval 
from a to b. This symbol is usually reserved for the case a < b, but it 1s sometimes 
used for a = b, also. The usual pictures for the intervals (a, b) and [a, b| are shown 
in Figure 3; since no reasonably accurate picture could ever indicate the difference 
between the two intervals, various conventions have been adopted. Figure 3 also 
shows certain “infinite” tervals. The set {x : x > a} is denoted by (a, oo), 
while the set {x : x > a} is denoted by {a, 00); the sets (—00, a) and (—o0, a| are 
defined similarly. At this pomt a standard warning must be issued: the symbols oo 
and —oo, though usually read “infinity” and “minus infinity,” are purely suggestive; 
there is no number “oo” which satisfies oo > a for all numbers a. While the 
symbols oo and —oo will appear in many contexts, it is always necessary to define 
these uses in ways that refer only to numbers. ‘The set R of all real numbers is 
also considered to be an “interval,” and is sometimes denoted by (—oo, 00). 


Of even greater interest to us than the method of drawing numbers is a method 
of drawing pairs of numbers. This procedure, probably also familiar to you, re- 
quires a “coordinate system,” two straight lines mtersecting at right angles. To 
distinguish these straight lines, we call one the horizontal axis, and one the vertical 
axis. (Nore prosaic terminology, such as the “first” and “second” axes, is probably 
preferable from a logical pomt of view, but most people hold their books, or at 
least their blackboards, in the same way, so that “horizontal” and “vertical” are 
more descriptive.) Each of the two axes could be labeled with real numbers, but 
we can also label points on the horizontal axis with pairs (a, 0) and points on the 
vertical axis with pairs (0, >), so that the intersection of the two axes, the “origin” 
of the coordinate system, 1s labeled (0,0). Any pair (a,b) can now be drawn as 
in Figure 4, lying at the vertex of the rectangle whose other three vertices are la- 
beled (0, 0), (a, 0), and (0, b). The numbers a and b are called the first and second 
coordinates, respectively, of the point determined in this way. 


Our real concern, let us recall, is a method of drawing functions. Since a func- 
tion is just a collection of pairs of numbers, we can draw a function by drawing 
each of the pairs in the function. The drawing obtained in this way is called the 
graph of the function. In other words, the graph of f contains all the points cor- 
responding to pairs (x, f(x)). Simce most functions contain infinitely many pairs, 
drawing the graph promises to be a laborious undertaking, but, in fact, many 
functions have graphs which are quite easy to draw. 


Not surprisingly, the simplest functions of all, the constant functions f(x) = ¢, 
have the simplest graphs. It is easy to see that the graph of the function f(x) = ¢ 
is a straight line parallel to the horizontal axis, at distance c from it (Figure 5). 


The functions f(x) = cx also have particularly simple graphs straight lines 
through (0,0), as in Figure 6. A proof of this fact is mdicated im Figure 7: 
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Let x be some number not equal to 0, and let L be the straight line which passes 
through the origin O, corresponding to (0,0), and through the poimt A, corre- 
sponding to (v,cx). A point A’, with first coordmate y, will lie on L when the 
triangle A’B’O is similar to the triangle ABO, thus when 


Gs cx) Ae = AB = 
OB’ OB 


(Ce 


this is precisely the condition that A’ corresponds to the pair (y, cy), Le., that A’ 
les on the graph of f. The argument has implicitly assumed that c > 0, but the 
other cases are treated easily enough. The number c, which measures the ratio of 
the sides of the triangles appearing in the proof, is called the slope of the straight 
niga. 7 line, and a line parallel to this line is also said to have slope c. 


O= (0,0) 


This demonstration has neither been labeled nor treated as a formal proof. 

Indeed, a rigorous demonstration would necessitate a digression which we are 

not at all prepared to follow. The rigorous proof of any statement connecting 

geometric and algebraic concepts would first require a real proof (or a precisely 

(ova stated assumption) that the pomts on a straight line correspond in an exact way 
to the real numbers. Aside from this, it would be necessary to develop plane 

| lenghhd—b geometry as precisely as we intend to develop the properties of real numbers. 
(a, b) Now the detailed development of plane geometry is a beautiful subject, but it is by 
Rai 2s no means a prerequisite for the study of calculus. We shall use geometric pictures 

only as an aid to intuition; for our purposes (and for most of mathematics) it is 
perfectly satisfactory to define the plane to be the set of all pairs of real numbers, 
and to define straight lines as certain collections of pairs, including, among others, 


ee ees the collections {(x, cx) : x a real number}. ‘To provide this artificially constructed 
geometry with all the structure of geometry studied in high school, one more 
definition is required. If (a,b) and (c,d) are two points in the plane, 1.e., pairs of 
real numbers, we define the distance between (a,b) and (c. d) to be 


JV (a—c)? + (b—d)?. 


If the motivation for this definition is not clear, Figure 8 should serve as adequate 
explanation—with this definition the Pythagorean theorem has been built into our 
geometry.* 

Reverting once more to our informal geometric picture, it is not hard to see 
(Figure 9) that the graph of the function f(~) = cx +d is a straight line 
with slope c, passing through the point (0.d). For this reason, the functions 


f(x) = cx +d are called linear functions. Simple as they are, Imear func- 


tions occur frequently, and you should feel comfortable working with them. The 
following is a typical problem whose solution should not cause any trouble. Given 


two distinct points (a,b) and (c,d), find the hnear function f whose graph goes 
FIGURE 9 through (a,b) and (c,d). This amounts to saying that f(a) = b and f(c) =d. If 


*"Vhe fastidious reader might object to this definition on the grounds that nonnegative numbers 
are not yet known to have square roots. ‘Phis objection is really unanswerable at the moment— the 
definition will just have to be accepted with reservations, until this httle pomt is settled. 


(c) (d) 


FIGURE 10 
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f is to be of the form f(x) = ax + f, then we must have 


aa+Bp=b, 
ac+ B=d: 
therefore @ = (d — b)/(c — a) and B = b — [(d — b)/(c — a) a, so 
d—b d—b d—b 
Fee x+b— a (x —a) +b, 
c—a c—a c-—a 


a formula most easily remembered by using the “poit-slope form” (see Problem 6). 

Of course, this solution is possible only if a 4 c; the graphs of linear functions 
account only for the straight lines which are not parallel to the vertical axis. ‘The 
vertical straight lines are not the graph of any function at all; in fact, the graph of a 
function can never contain even two distinct pomts on the same vertical line. This 
conclusion is immediate from the definition of'a function — two pots on the same 
vertical line correspond to pairs of the form (a,b) and (a,c) and, by definition, a 
function cannot contain (a,b) and (a,c) if b 4c. Conversely, if'a set of points mn 
the plane has the property that no two points lie on the same vertical line, then 
it is surely the graph ofa function. Thus, the first two sets in Figure 10 are not 
graphs of functions and the last two are; notice that the fourth is the graph of a 
function whose domain is not all of R, since some vertical lines have no points on 
them at all. 

After the linear functions the simplest is perhaps the function f(x) = x. If we 
draw some of the pairs in f, 1.e., some of the pairs of the form (x, x”), we obtain 
a picture like Figure I 1. 


@ (2,4) 


e@(5, 


(0, 0) 


CRON TRST A, 1] 


60 foundations 


RG URE 2 


(b) 


(c) 
PIG ORE 13 


It is not hard to convince yourself that all the pairs (x, x) lie along a curve like 
the one shown in Figure 12; this curve is known as a parabola. 

Since a graph is just a drawing on paper, made (in this case) with printer’s ink, 
the question “Is this what the graph really looks like?” is hard to phrase in any 
sensible manner. No drawing ts ever really correct smce the hne has thickness. 
Nevertheless, there are some questions which one can ask: for example, how can 
you be sure that the graph does not look like one of the drawings in Figure 13? 
It is easy to see, and even to prove, that the graph cannot look lke (a); for if 
0 <x < y, then x* < y?, so the graph should be higher at y than at x, which is 
not the case in (a) . It 1s also easy to see, simply by drawing a very accurate graph, 
first plotting many pairs (x, x7), that the graph cannot have a large “jump” as in (b) 
or a “corner” as m (c). In order to prove these assertions, however, we first need 
to say, in a mathematical way, what it means for a function not to have a “jump” 
or “corner”; these ideas already involve some of the fundamental concepts of 
calculus. Eventually we will be able to define them rigorously, but meanwhile you 
may amuse yourself by attempting to define these concepts, and then examining 
your definitions critically. Later these definitions may be compared with the ones 
mathematicians have agreed upon. If they compare favorably, you are certainly 
to be congratulated! 

The functions f(x) = x", for various natural numbers n, are sometimes called 
power functions. Their graphs are most easily compared as in Figure 14, by 
drawing several at once. 

The power functions are only special cases of polynomial functions, mtroduced 
in the previous chapter. ‘Two particular polynomial functions are graphed in 
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Figure 15, while Figure 16 is meant to give a general idea of the graph of the 
polynomial function 


f)= (i a i me a ateeCe 


in the case a, > 0. 

In general, the graph of f will have at most 2 — 1 “peaks” or “valleys” (a “peak” 
is a point like (x, f(x)) in Figure 16, while a “valley” is a poit like (y, f(y)). The 
number of peaks and valleys may actually be much smaller (the power functions, 
for example, have at most one valley). Although these assertions are easy to make, 
we will not even contemplate giving proofs until Part III (once the powerful meth- 
ods of Part III are available, the proofs will be very easy). 

Figure 17 illustrates the graphs of several rational functions. The rational func- 
tions exhibit even greater variety than the polynomial functions, but their behavior 
will also be easy to analyze once we can use the derivative, the basic tool of Part ITI. 

Many interesting graphs can be constructed by “piecing together” the graphs of 
functions alreacly studied. The graph in Figure 18 is made up entirely of straight 
lines. ‘The function f with this graph satisfies 


f @ = (pyr, 
n 

=i +1 

fl{—)=C(-b"™, 
n 


f@=t ble], 


and is a linear function on each interval [1/(n +1), 1/n] and [—1/n, -1/(n4+ 1]. 
(The number 0 is not in the domain of f.) Of course, one can write out an explicit 
formula for f(x), when x is in [1/(a2 + 1), 1/n]; this is a good exercise in the use 
of linear functions, and will also convince you that a picture is worth a thousand 
words. 


n even n odd 
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It is actually possible to define, in a much simpler way, a function which exhibits 
this same property of oscillating infinitely often near 0, by using the sine function, 
which we will discuss in detail in Chapter 15. As usual, we are using radian 
measure, so an angle of 27 means an angle “all the way around” a circle, an 
angle of z an angle half way around (or 180° in layman’s terms), an angle of 2/2 
a right angle, ete. 

The graph of the sine function is shown in Figure 19. 


(C2) = Sines 
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Now consider the function f(x) = sin1/x. The graph of f is shown in Fig- 
ure 20. ‘To draw this graph it helps to first observe that 


ae | | 
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Notice that when x is large, so that 1/x 1s small, f(x) 1s also small; when x 1s 


FIGURE 20 
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FIGURE 21 
“large negative,” that is, when |x| is large for negative x, again f(x) 1s close to 0, 
although f(x) < 0. 

An interesting modification of this function is f(x) = x sin1/x. The graph of 
this function is sketched in Figure 21. Since sin | /x oscillates infinitely often near 0 
between | and —1, the function f(x) = x sin 1/x oscillates infinitely often between 
x and —x. The behavior of the graph for x large or large negative is harder to 
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analyze. Since sin |/x is getting close to 0, while x is getting larger and larger, there 
seems to be no telling what the product will do. It 7s possible to decide, but this 1s 
another question that is best deferred to Part HI. The graph of f(x) = x7 sin I/x 
has also been illustrated (Figure 22). 

For these infinitely oscillating functions, it is clear that the graph cannot hope to 
be really “accurate.” The best we can do is to show part of it, and leave out the 
part near 0 (which is the interesting part). Actually, it is easy to find much simpler 
functions whose graphs cannot be “accurately” drawn. The graphs of 
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can only be distinguished by some convention similar to that used for open and 
closed intervals (Figure 23). 
Out last example is a function whose graph is spectacularly nondrawable: 


0, x irrational 
f(x) = : 
1, x rational. 
1, x rational 
fa) = - 
QO, x irrational 


FIGURE 24 


The graph of f must contain infinitely many points on the horizontal axis and 
also mfinitely many points on a line parallel to the horizontal axis, but it must not 
contain either of these lines entirely. Figure 24 shows the usual textbook picture 
of the graph. ‘To distinguish the two parts of the graph, the dots are placed closer 
together on the line corresponding to irrational x. (There is actually a mathemat- 
ical reason behind this convention, but it depends on some sophisticated ideas, 
introduced in Problems 21-5 and 21-6.) 

The peculiarities exhibited by some functions are so engrossing that it is easy 
to forget some of the simplest, and most important, subsets of the plane, which 
are not the graphs of functions. The most important example of all is the circle. 
A circle with center (a, b) and radius r > 0 contains, by definition, all the points 
(x, y) whose distance from (a, b) is equal to r. The circle thus consists (Figure 25) 
of all pomts (x, y) with 


Vv (x _ a)? +(v- b)* =; 


or 


(en a)? + (y— BY =r’. 
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The circle with center (0,0) and radius 1, often regarded as a sort of standard copy, 
is called the wnt circle. 

A close relative of the circle is the ellipse. This is defined as the set of points, 
the swn of whose distances from two “focus” points is a constant. (When the two 
foci are the same, we obtain a circle.) If, for convenience, the focus points are 
taken to be (—c, 0) and (c, 0), and the sum of the distances is taken to be 2a (the 
factor 2 simplifies some algebra), then (x, y) is on the ellipse if and only if 


V & SC o))r ss yo by G@ oO) bye = 2a 


or 
V (ae -be) By = 2a Vv Ge) ye 
or 
42 + Dex tic? + ve = 4a* — 4a v (x — c)? + y? 4x” — Dex + ¢7 + y? 
or 
4(cx — a’) = —4dav(x — c)? + we 
or 
c7x? — Iexa® +.a* = a(x? —2cx +c? + y’) 
or 
(c? = a*)x? - ay” a8 a*(c? -_ a’) 
or 


2) 9) 
fi) Wat A 4 
a Na = 6 
This is usually written simply 
2 2 
Say cee | 
ar 
where b = ya*—c? (since we must clearly choose a > c, it follows that 


a* —c* > 0). A picture of an ellipse is shown in Figure 26. The ellipse inter- 
sects the horizontal axis when y = Q, so that 


—=1, = sea, 


FIGURE 26 


FIGURE 27 
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and it intersects the vertical axis when x = 0, so that 
2 
Y 
a = 1, = 9. 
De 
The hyperbola is defined analogously, except that we require the difference of 
the two distances to be constant. Choosing the points (—c,0) and (c,0) once 
again, and the constant difference as 2a, we obtain, as the condition that (x, y) 


be on the hyperbola, 


Vee yo v(x —c)? + y= 42a 


which may be simplified to 


. =. 
In this case, however, we must clearly choose c > a, so that a“ — c < 0. If 


b = Vc? — a?, then (x, y) is on the hyperbola if and only if 


az bt 

The picture is shown in Figure 27. It contains two pieces, because the difference 

between the distances of (x, y) from (—c, 0) and (c,0) may be taken in two dif- 

ferent orders. The hyperbola intersects the horizontal axis when y = 0, so that 
x = +a, but it never intersects the vertical axis. 

It is interesting to compare (Figure 28) the hyperbola with a = b = V2 and 


the graph of the funcuon f(x) = 1/x. The drawings look quite similar, and 
the two sets are actually identical, except for a rotation through an angle of 2/4 
(Problem 23). 


Clearly no rotation of the plane will change circles or ellipses mto the graphs of 
functions. Nevertheless, the study of these mportant geometric figures can often 
be reduced to the study of functions. Ellipses, for example, are made up of the 


TGs Rat 2i8 
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graphs of two functions, 


Tay=bvl— (x7 /a?), —a<x<a 
and 
g(x) = —bV 1 — (x7/a’), Geen < a: 


Of course, there are many other pairs of functions with this same property. For 
example, we can take 


pel Sh). O=x =< 


f(x) = 
—bV1l— Gla). -—a<x <0 
and 
() —bvl1l— (G/a>). Vy =a 
g(x) = 


bv1l— (x7 /a?. —a<x <0. 
We could also choose 


eo} . 
bv1l—- Gr /a: x rational, —a <x 


<a 
f(x) = 
—bvl— Gal). x irrational, -a <x <a 
and 
—bV1—(x*/a*), x rational, —a<x <a 
g(x) = 


Dy |= (Ga), x irrational, —a <x <a. 


But all these other pairs necessarily involve unreasonable functions which jump 
around. A proof, or even a precise statement of this fact, is too difficult at present. 
Although you have probably already begun to make a distinction between those 
functions with reasonable graphs, and those with unreasonable graphs, you may 
find it very difficult to state a reasonable definition of reasonable functions. A 
mathematical definition of this concept is by no means easy, and a great deal of this 
book may be viewed as successive attempts to impose more and more conditions 
that a “reasonable” function must satisfy. As we define some of these conditions, 
we will take time out to ask if we have really succeeded in isolating the functions 
which deserve to be called reasonable. ‘The answer, unfortunately, will always be 
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no,” or at best, a qualified “yes.” 


PROBLEMS 


1. Indicate on a straight line the set of all x satisfying the following conditions. 
Also name each set, using the notation for intervals (in some cases you will 
also need the U sign). 


(i) |x —3|] <1. 
(7) es) = E 


(i) |x —al <e. 


Ni— 


Hee) Bee = 1 
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| I 
(v) ae 
sees 
(v1) gia < a (give an answer in terms of a, distinguishing various cases). 
Ge 


(vii) x° +1 > 2. 
(vit) (x + 1) — I(w — 2) > 0. 


There is a very useful way of describing the points of the closed interval [a, b] 
(where we assume, as usual, that a < b). 


(a) First consider the interval [0, b], for b > 0. Prove that if x is im [0, b], 
then « = tb for some t with O < t < 1. What is the significance of the 
number ¢? What is the mid-point of the interval [0, b]? 

(b) Now prove that if x is in [a, b], then x = (1 — t)a + tb for some ¢ with 
Q <+¢ <1. Hint: This expression can also be written as a + t(b — a). 
What is the midpoint of the interval [a,b]? What is the point 1/3 of the 
way from a to b? 

(c) Prove, conversely, that if O <+¢ < 1, then (1 — ft)a + tb is in [a, db]. 

(d) The points of the open interval (a,b) are those of the form (1 — t)a + tb 
for 0<% <4 


Draw the set of all points (x, y) satisfying the followmeg conditions. (In most 
cases your picture will be a sizable portion of'a plane, not just a line or curve.) 


O} mee 
(nt) x+ta>ytb. 
jee ee 
tiv) ey ert 


(vy) |x-yl<l. 


vi) |[x+ty| <1. 
vil) x + y is an integer. 
mi, ia 
(vil) Is an integer. 
X gi iy : 
Gf. fy) ) 
(ix) (x~—1)*+(y-2)° <1. 


(x) Mee = y< cd 


Draw the set of all pomts (x, vy) satisfying the following conditions: 


()  Ixl+ lye. 

Gi) I|-Il=. 

Git) jx — 1] =|y— I]. 
(iv) |l—-x|= [y— 1]. 
(vy) x7+ y2=0. 

(wi heentay ica): 
Cr, fey 


joes y 
(vill) x" = soe 
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(1, m) 


HGWEReE 2.9 


Cl 7) 


Draw the set of all points (x, y) satisfying the following conditions: 


oa 

y2 x2 

~ a 
a be 

r= ly| 
sin 


Hint: You already know the answers when x and y are mterchanged. 


(a) 


(b) 


Show that the straight line through (a, b) with slope m is the graph of the 
function f(x) = m(x —a)+b. This formula, known as the “point-slope 
form” is far more convenient than the equivalent expression f(x) = 
mx + (b—ma); it is immediately clear from the poit-slope form that the 
slope is m, and that the value of f at a is b. 

For a # c, show that the straight line through (a, b) and (c,d) is the 
graph of the function 


» ae 


i (x —a) +b. 


(Cane! 


When are the graphs of f(x) = mx +b and g(x) = m’x + D’ parallel 
straight lines? 


For any numbers A, B, and C, with A and B not both O, show that the 
set of all (x, y) satisfying Ax + By + C = 01s a straight line (possibly a 
vertical one). Hint: First decide when a vertical straight line is described. 
Show conversely that every straight line, including vertical ones, can be 
described as the set of all (x, y) satisfying Ax + By + C = 0. 


Prove that the graphs of the functions 


f(x) = mx + b, 
Veg 0) i= 1 (8 cay om 


are perpendicular if ma = —1, by computing the squares of the lengths 
of the sides of the triangle in Figure 29. (Why is this special case, where 
the Ines mtersect at the origin, as good as the general case?) 
Prove that the two straight lines consisting of all (v, y) sausfying the con- 
ditions 
Ax+ By +C =0, 
A'x+ By +C’ =0, 


are perpendicular if and only if AA’+ BB’ = 0. 


Prove, using Problem 1-19, that 


Vv (4 +7 aes (2)++ y2)? = xy? =r xy = V ve oy y2. 


10. 


Lh. 


L2. 


13; 


14. 
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(b) Prove that 


Ce ee (isu y1)? i ae Wypem y1)" 


+ V (x3 — x2)? + (3 = y2)’. 


Interpret this equality geometrically (it is called the “triangle mequal- 
ity”). When does strict Inequality hold? 


Sketch the graphs of the following functions, plotting enough points to get 
a good idea of the general appearance. (Part of the problem is to make 
a reasonable decision how many is “enough”; the queries posed below are 
meant to show that a little thought will often be more valuable than hundreds 
of individual pots.) 


l 
(i)  f(«) =x + —. (What happens for x near 0, and for large x? Where 
x 


does the graph he in relation to the graph of the identify function? Why 
does it suffice to consider only positive x at first?) 


] 
fa) Bj Se =) 

x 
(int) (ee 
a AC 


Describe the general features of the graph of f if 


(i) | ef 18 e#en. 

(in) ef aissodd: 

(iil) f is nonnegative. 

(iv) f(x) = f(x +a) for all x (a function with this property is called peri- 
odic, with period a. 


Graph the functions f(x) = %/x for m = 1, 2, 3, 4. (There is an casy way to 
do this, using Figure 14. Be sure to remember, however, that %/x means the 
positive mth root of x when m is even; you should also note that there will be 
an important difference between the graphs when m is even and when mm is 
odd.) 


(a) Grip a = |xl-and (Ce) — ee 

(by Graph Os) — | sinx| and 7) — sin? x. (There is an important difler- 
ence between the graphs, which we cannot yet even describe rigorously. 
See if you can discover what it is; part (a) is meant to be a clue.) 


Describe the graph of g in terms of the graph of f if 
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15. 


16. 


V7, 


18. 


(i) = ge) aCe =e 

(1) g(x) = f(x +c). (It is easy to make a mistake here.) 

a ce a oa (Distinguish the cases c = 0, c > 0, c < 0.) 
(v) g(x) = f/x). 

(vi) giv) = f(x). 

(vit) ga) =/f QI. 

(vii) g(x) = max(f. 0). 

i= step aint f, 0)? 

(e) ieee) — miax( f, 1°). 


Draw the graph of f(x) = ax? + bx +c. Hint: Use the methods of Prob- 
lem I-18. 


Suppose that A and C are not both 0. Show that the set ofall (x, y) satisfying 
OI ? 

Ax” i BX + Chime Dy + EF = 0 
is either a parabola, an ellipse, or an hyperbola (or a “degenerate case”: two 
lines [either intersecting or parallel], one ne, a point, or ¥). Hint: The 
case C = 0 is essentially Problem 15, and the case A = 0 is just a minor 
variant. Now consider separately the cases where A and B are both positive 
or negative, and where one 1s positive while the other is negative. When do 
we have a circle? 
The symbol [x] denotes the largest integer which is < x. Thus, [2.1] = [2] = 
2 and [—0.9] = [-—1] = —1. Draw the graph of the following functions 
(they are all quite interesting, and several will reappear frequently in other 
problems). 
@)  f() =[y]. 
(1) fi Ga jieses "(en 
Gin) f Goi — (x1. 
iv) $@)=[s]+ Vr—GI. 


| 
vv) f@= =| 
X 


(ui) Fe) = Bl 
x 


Graph the following functions. 
(i) f(x) = {x}, where {x} is defined to be the distance from x to the nearest 
integer, 


Mi) os eee 


FIGURE 30 
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Many functions may be described in terms of the decimal expansion of a num- 
ber. Although we will not be mm a position to describe infinite decimals rigorously 
until Chapter 23, your intuitive notion of infinite decimals should suffice to carry 
you through the followimg problem, and others which occur before Chapter 23. 
‘There is one ambiguity about infinite decimals which must be eliminated: Every 
decimal ending in a string of 9’s is equal to another ending in a string of 0's (e.g, 


1.23999... = 1.24000...). We will always use the one ending in 9’s. 


is Bo 


20 


21. 


aes 


Describe as best you can the graphs of the following functions (a complete 
picture is usually out of the question). 


(1) f(x) = the Ist number in the decimal expansion of x. 

(ii) = f(¥) = the 2nd number in the decimal expansion of x. 

(iit) f(x) = the number of 7’s in the decimal expansion of x if this number 
is finite, and O otherwise. 

(iv) f(x) = 0 if the number of 7’s in the decimal expansion of x is finite, 
and 1 otherwise. 

(v) f(x) = the number obtained by replacing all digits in the decimal 
expansion of x which come after the first 7 (if any) by 0. 

(vi) f(x) =O if 1 never appears in the decimal expansion of x, and n if 1 
first appears in the nth place. 


f(x) = 


0, x irrational 

] p : : 

—, Xx == rational in lowest terms. 

q q 

(A number p/q is in lowest terms if p and q are integers with no common 
factor, and q > 0). Draw the graph of f as well as you can (don’t sprinkle 
points randomly on the paper; consider first the rational numbers with q = 2, 
then those with gq = 3, etc.). 


(a) The points on the graph of f(x) = x? are the ones of the form (x, x7). 
Prove that each such point is equidistant from the point (0, ) and the 
eraph of g(x) = —f. (See Figure 30.) 

(b) Given a horizontal line L, the graph of g(x) = y, anda point P = (a, B) 
not on L, so that y # f, show that the set of all points (x, y) equidistant 
from P and L is the graph of a function of the form f(x) = ax*+bx +c. 
What is this set if y = B? 


(a) Show that the square of the distance from (c,d) to (x,m-x) is 
x2(m + 1)+x«(-—2md —2c)+ ees 


Using Problem 1-18 to find the minimum of these numbers, show that 
the distance from (c, d) to the graph of f(x) = m-x is 


lem — d|/V m2 +1. 


(b) Find the distance from (c,d) to the graph of f(x) = mx +b. (Reduce 
this case to part (a).) 
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*23. (a) Using Problem 22, show that the numbers x’ and y’ indicated in Fig- 
ure 31 are given by 


/ 
a 


| l 
pi wile) 
v2 
1 l 
ee ea a) 
vo. wD 
(b) Show that the set of all (x, y) with (x’/V2)? — (y'/V2)* = 1 is the same 


FIGURE 31 as the set of all (x, y) with xy = 1. 


length y’ 


FIGURE |} 


(vy + wi, v2 + w2) 


FIGURE 2 


(v1, v2) 


(v2 + w2) — v2 


Se 
(Oia we) Ut 
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APPENDIX 1.. VECTORS 


Suppose that v is a point in the plane; in other words, v is a pair of numbers 
v= (a, Vaz 


For convenience, we will use this convention that subscripts indicate the first and 
second pairs of a point that has been described by a single letter. ‘Thus, if we 
mention the points w and z, it will be understood that w is the pair (wy), w2), 
while z is the pair (Z, 22). 

Instead of the actual pair of numbers (vj, v2), we often picture v as an arrow 
from the origin O to this point (Figure 1), and we refer to these arrows as vectors 
in the plane. Of course, we’ve haven't really said anything new yet, we've simply 
introduced an alternate term for a point of the plane, and another mental picture. 
The real point of the new termimology is to emphasize that we are going to do 
some new things with points in the plane. 

For example, suppose that we have two vectors (i.e., points) in the plane, 


v=(vj, 02), w= (Ww), w72). 
Then we can define a new vector (a new point of the plane) v + w by the equation 
(1) v+w =(v, + wv). v2 + wW2). 


Notice that all the letters on the right side of this equation are numbers, and the 
+ sign is just our usual addition of numbers. On the other hand, the + sign on 
the left side is new: previously, the sum of two points in the plane wasn’t defined, 
and we've simply used equation (1) as a definition. 

A very fussy mathematician might want to use some new symbol for this newly 
defined operation, like 


Uw, or perhaps v@w, 


but there’s really no need to insist on this; sce v + w hasn’t been defined before, 
there’s no possibility of confusion, so we might as well keep the notation simple. 
Of course, any one can make new notation; for example, since it’s our definition, 
we could just as well have defined v + w as (vj + wy + w2, v2 + wy"), or by some 
other equally weird formula. The real question is, does our new construction have 
any particular significance? 
Figure 2 shows two vectors v and w, as well as the point 


(vj + wy), v2 + w2), 


which, for the moment, we have simply indicated in the usual way, without drawing 
an arrow. Note that it is easy to compute the slope of the ine L between v and 
our new point: as indicated in Figure 2, this slope is just 


(75 W2) — 9 We 


(vy; +w))— v wy 


. 


and this, of course, is the slope of our vector w, from the origin O to (w), w2). In 
other words, the line L is parallel to w. 
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FIGURE 3 


FIGURE 4 


PPG GRE 5 


Similarly, the slope of the line M between (wy , w2) and our new point is 
ys P 1, W2 ] 


(ax w2) = wa Fu. 


(U) Fw) eee 
which is the slope of the vector v; so M is parallel to v. In short, the new point 
v+w lies on the parallelogram having v and w as sides. When we draw v + w as 
an arrow (Figure 3), it points along the diagonal of this parallelogram. In physics, 
vectors are used to symbolize forces, and the sum of two vectors represents the 
resultant force when two different forces are applied simultaneously to the same 
object. 

Figure 4 shows another way of visualizing the sum v+w. Ifwe use “w” to denote 
an arrow parallel to w, and having the same length, but starting at v instead of at 
the origin, then v + w is the vector from O to the final endpoint; thus we get to 
v + w by first following v, and then following w. 

Many of the properties of + for ordinary numbers also hold for this new + for 
vectors. For example, the “commutative law” 


v+w=w-+u, 


is obvious from the geometric picture, since the parallelogram spanned by v and 
w is the same as the parallelogram spanned by w and v. It is also easily checked 
analytically, since it states that 


(Vwi 02 FW?) = (wT + V1, We U2), 
and thus simply depends on the commutative law for numbers: 


vip tw) =w,4+U;, 
Ub) sab) = Dy Se Wc 


© 


Similarly, unraveling definitions, we find the “associative law” 
[vt+w] +e=v0+ [wt gl. 


Figure 5 indicates a method of finding v + w + z. 
The origin O = (0, 0) is an “additive identity,” 


O+vz=v+O0=0, 


and if we define 


=) = (=i, a. 


then we also have 
v+(-v) = -—vtv=0. 


Naturally we can also define 
w—-v=w+(—-v), 
exactly as with numbers; equivalently, 


w—v = (wy — vy. wo — U2). 


“w—o—v 
v 
(a) 
Ww ATH) = yp” 
v 
(b) 
FIGURE 6 


PIG WR 7 


FIGURE 8 


> 


4, Appendix 1. Vectors 77 


Just as with numbers, our definition of w — v simply means that it satisfies 
vp —a) = w. 


Figure 6(a) shows v and an arrow “w — v” that is parallel to w — v but that starts 
at the endpoint of v. As we established with Figure 4, the vector from the origin 
to the endpoint of this arrow is just v + (w — v) = w (Figure 6(b)). In other words, 
we can picture w — v geometrically as the arrow that goes from v to w (except that 
it must then be moved back to the origin). 

‘There is also a way of multiplying a number by a vector: For a number a and 
a vector v = (vj, v2), we define 


ae (iia us) 


(We sometimes simply write av instead of a - v; of course, it is then especially 
important to remember that v denotes a vector, rather than a number.) ‘The 
vector a+ v points in the same direction as v when a > 0 and in the opposite 
direction when a < 0 (Figure 7). 

You can easily check the following formulas: 


Gan Dieey) = (alana, 


| Sa 
a = 10), 
=) of =. 


Notice that we have only defined a product of a number and a vector, we have 
not defined a way of ‘multiplying’ two vectors, to get another vector.* However, 
there are various ways of ‘multiplying’ vectors to get numbers, which are explored 
in the following problems. 


PROBLEMS 


1. Given a point v of the plane, let Rg(v) be the result of rotating v around the 
origin through an angle of 6 (Figure 8). ‘The aim of this problem is to obtain 
a formula for Rg, with minimal calculation. 


(a) Show that 


Ra, = (cos OF sim @), 
Re(O, 1) = (—sin 8, cos 8). 


[we should really write Rg((1, 0)), ete.] 


(b) Explain why we have 


Ro(v + w) = Re(v) + Re(w), 
Re(a-w)=a- Ro(w). 


(c) Now show that for any point (x, y) we have 
Re(x, y) = (x cos6 — ysin8, xsn@ + ycos@). 
*If you jump to Chapter 25, you'll find that there is an important way of defining a product, but 


this is something very special for the plane—it doesn’t work for vectors in 3-space, for example, even 
though the other constructions do. 
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(d) 


Use this result to give another solution to Problem 4-23. 


Given v and w, we define the number 


Ve W = vw + Y2W2; 


this is often called the ‘dot product’ or ‘scalar product’ of v and w (‘scalar’ 


being a rather old-fashioned word for a number, as opposed to a vector). 


(a) 
(b) 


Given v, find a vector w such that v- w = 0. Now describe the set of all 
such vectors w. 
Show that 


VDeU =wev 


v9 (te zZ) SVs Wit szZ 
and that 
aU. Wa 0) ws =) - (a - wip 


Notice that the last of these equations involves three products: the dot 
product + of two vectors; the product + of a number and a vector; and 
the ordinary product - of two numbers. 

Show that v-v > 0, and that v- vy = 0 only when v = O. Hence we can 
define the norm ||v|| as 


lull = Vor, 


which will be 0 only for v = O. What is the geometric interpretation of 
the norm? 
Prove that 

|v + wll < [lull + [lw 


and that equality holds if and only if v = 0 or w = 0 or w =a- v for 
some number a > 0. 

Show that 

|v + wll? = lv — wll? 


4 


Let Rg be rotation by an angle of 6 (Problem 1). Show that 


Usa = 


Re(v) > Re(w) =v-w. 


Let e = (1, 0) be the vector of length | pointing along the first axis, and 
let w = (cos@, sin @); this is a vector of length | that makes an angle of 6 
with the first axis (Compare Problem 1). Calculate that 


@-nt — COs: 
Conclude that in general 
vs w = |p] - |lwl] -cosdé, 


where @ is the angle between v and w. 


FIGURE 9 


Ww 


CCE MS)8, 1800, 
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Given two vectors v and w, we'd expect to have a simple formula, involving 
the coordinates vy), v2, wy, W2, for the area of the parallelogram they span. 
Figure 9 indicates a strategy for finding such a formula: since the triangle 
with vertices w, A,v + w is congruent to the triangle OBv, we can reduce 
the problem to an easier one where one side of the parallelogram lies along 
the horizontal axis: 
(a) ‘The line L passes through v and 1s parallel to w, so has slope w2/wy. 
Conclude that the point B has coordinate 
VU] W2 — W102 


w2 
and that the parallelogram therefore has area 
det(v, w) = vy w2 — wy v2. 
This formula, which defines the determinant det, certainly seems to be simple 


enough, but it can’t really be true that det(v, w) always gives the area. After 
all, we clearly have 


det(w, v) = — det(v, w), 


so sometimes det will be negative! Indeed, it is easy to see that our “deriva- 

tion” made all sorts of assumptions (that w2 was positive, that B had a positive 

coordinate, etc.) Nevertheless, it seems likely that det(v, w) is + the area; the 
next problem gives an independent proof. 

(a) If v poimts along the positive horizontal axis, show that det(v, w) is the 
area of the parallelogram spanned by v and w for w above the horizontal 
axis (w2 > QO), and the negative of the area for w below this axis. 

(b) If Rg is rotation by an angle of @ (Problem 1), show that 


det(Rev, Row) = det(v, w). 


Conclude that det(v, w) is the area of the parallelogram spanned by 
v and w when the rotation from v to w is counterclockwise, and the 
negative of the area when it is clockwise. 


Show that 


det(v, w + z) = det(v, w) + det(v, z 
det(v + w, z) = det(v, z) + det(w, z) 


and that 
a det(v, w) = det(a- v, w) = det(v, a- w). 


Using the method of Problem 3, show that 
det(v, w) = |lv|] - ||w] - sin @, 


which is also obvious from the geometric interpretation (Figure 10). 
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APPENDIX.2. THE CONIG SECTIONS 


Although we will be concerned almost exclusively with figures in the plane, 
defined formally as the set of all pairs of real numbers, in this Appendix we want 
to consider three-dimensional space, which we can describe in terms of triples of 
real numbers, using a “three-dimensional coordinate system,” consisting of three 
straight lines intersecting at right angles (Figure 1). Our horizontal and vertical axes 
now mutate to two axes in a horizontal plane, with the third axis perpendicular to 
both. 

One of the simplest subsets of this three-dimensional space is the (infinite) cone 
illustrated in Figure 2; this cone may be produced by rotating a “generating line,” 
of slope C say, around the third axis. 


FIGURE 2 
For any given first two coordinates x and _y, the point (x, y, 0) in the horizontal 
. ay aM on O10 
plane has distance Vx" + y* from the origin, and thus 
. ove vey 9) 9) 
(1) (20) 1s On the¢one 1! and only 127 —=2Cvx 7 y= 


We can descend from these three-dimensional vistas to the more familiar two- 
dimensional one by asking what happens when we intersect this cone with some 
plane P (Figure 3). 


EG WS 


If the plane is parallel to the horizontal plane, there’s certainly no mystery-~ the 
intersection is just a circle. Otherwise, the plane P intersects the horizontal plane 


slope —€ 


FIGURE 4 
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in a straight line. We can make things a lot simpler for ourselves if we rotate 
everything around the vertical axis so that this mtersection line points straight out 
from the plane of the paper, while the first axis is in the usual position that we 
are familiar with. ‘The plane P is thus viewed “straight on,” so that all we see 
(Figure 4) is its mtersection L with the plane of the first and third axes; from this 
view-point the cone itself simply appears as two straight lines. 

If this line L happens to be vertical, consisting of all points (a, z) for some a, 
then equation (1) says that the intersection of the cone and the plane consists of 
all points (a, y, z) with 

2 — C2y? = C2a?, 
which is an hyperbola. 

Otherwise, in the plane of the first and third axes, the line L can be described 
as the collection of all pomts of the form 


(x, Mx + B), 
where M 1s the slope of L. For an arbitrary point (x, y, z) it follows that 
(2) (x, y,Z) is in the plane P if and only if z = Mx + B. 


Combining (1) and (2), we see that (x, y, z) is in the intersection of the cone and 
the plane if and only if 


(«) Mx+B=4+Cvx*+4+y’. 


Now we have to choose coordinate axes in the plane P. We can choose L as the 
first axis, measuring distances from the intersection Q with the horizontal plane 
(Figure 5); for the second axis we just choose the line through Q parallel to our 
original second axis. If the first coordinate of a point in P with respect to these 
axes is x, then the first coordinate of this pomt with respect to the original axes 
can be written in the form 


ix 6 


for some @ and f. On the other hand, if the second coordinate of the point with 
respect to these axes is y, then y is also the second coordinate with respect to the 
original axes. 

Consequently, (*) says that the point lies on the intersection of the plane and the 
cone if and only if 


M(ax + p)+B=+CV(ax+f)*+y". 


Although this looks fairly complicated, after squaring we can write this as 
Ce OGM —C*)x* + Ex Hn =O 


for some FE and F that we won't bother writing out. 
Now Problem 4-16 indicates that this is either a parabola, an ellipse, or an 
hyperbola. In fact, looking a little more closely at the solution, we see that the 
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values of E and F are irrelevant: 


1) If M =+C we obtain a parabola; 
(2) If C? > M? we obtain an ellipse; 
(3) If C? < M? we obtain an hyperbola. 


‘These analytic conditions are easy to interpret geometrically (Figure 6): 


(1) If our plane is parallel to one of the generating lines of the cone we obtain 
a parabola; 

(2) If our plane slopes less than the generating line of the cone (so that our 
intersection omits one half of the cone) we obtain an ellipse; 

(3) If our plane slopes more than the generating line of the cone we obtain an 
hyperbola. 


et : 
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FIGURE 6 


In fact, the very names of these “conic sections” are related to this description. 
The word parabola comes from a Greek root meaning ‘alongside,’ the same root 
that appears in parable, not to mention paradigm, paradox, paragon, paragraph, 
paralegal, parallax, parallel, and even parachute. Ldipse comes from a Greek root 
meaning ‘defect, or omission, as in ellipsis (an omission, ... or the dots that in- 
dicate it). And hyperbola comes from a Greek root meaning ‘throwing beyond,’ or 
excess. With the currency of words like hyperactive, hypersensitive, and hyperven- 
tilate, not to mention hype, one can probably say, without risk of hyperbole, that 
this root is familiar to almost everyone.* 


PROBLEMS 


1. Consider a cylinder with a generator perpendicular to the horizontal plane 
(Figure 7); the only requirement for a poit (x, y,z) to lie on this cylinder is 
* Although the correspondence between these roots and the geometric picture correspond so beau- 


tfully, for the sake of dull accuracy it has to be reported that the Greeks originally apphed the words 
to describe features of certain equations involving the conic sections. 


FIGURE 8 
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that (x, y) hes on a circle: 
a) a 2) 
pap i 
Show that the intersection of a plane with this cylinder can be described by 
an equation of the form 


(ax + By + y =C’, 
What possibilities are there? 


In Figure 8, the sphere $; has the same diameter as the cylinder, so that its 
equator Cy lies along the cylinder; it is also tangent to the plane P at F;. 
Similarly, the equator Cz of Sz lies along the cylinder, and $2 is tangent to P 
at Fo. 


(a) Let z be any point on the intersection of P and the cylinder. Explain 
why the length of the line from z to Fyis equal to the length of the vertical 
lirre © fronr cto Cir 

(b) By proving a similar fact for the length of the line from z to Fy, show that 
the distance from z to F; plus the distance from z to F> is a constant, so 
that the intersection is an ellipse, with foci Fy and Fy. 


Similarly, use Figure 9(a) to prove geometrically that the intersection of a 
plane and a cone is an ellipse when the plane intersects just one half of the 
cone. Similarly, use (b) to prove that the intersection is an hyperbola when 


the plane intersects both halves of the cone. 
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APPENDIX 3. POLAR COORDINATES 


In this chapter we’ve been acting all along as if there’s only one way to label 
points in the plane with pairs of numbers. Actually, there are many different 
ways, each giving rise to a different “coordinate system.” The usual coordinates 
of a poimt are called its cartesian coordinates, after the French mathematician 
and philosopher René Descartes (1596-1650), who first introduced the idea of 
coordinate systems. In many situations it Is more convenient to introduce polar 
coordinates, which are illustrated in Figure |. To the point P we assign the polar 
coordinates (7,9), where r is the distance from the origin O to P, and 6 1s the 
measure, in radians, of the angle between the horizontal axis and the line from 
O to P. This @ is not determined unambiguously. For example, points on the 
right side of the horizontal axis could have either 6 = 0 or 6 = 27; moreover, 6 
is completely ambiguous at the origin O. So it is necessary to exclude some ray 
through the origin if we want to assign a unique pair (7,4) to each point under 
consideration. 


On the other hand, there is no problem associating a unique poimt to any pair 
(r,@). In fact, it is possible (though not approved of by all) to associate a point 
to (r,8@) when r < 0, according to the scheme indicated in Figure 2. ‘Thus, it 
always makes sense to talk about “the point with polar coordinates (r,@),” (with 
or without the possibility of r < Q), even though there is some ambiguity when we 
talk about “the polar coordinates” of a given point. 


length r 


P is the point with polar coordinates (r, 91) 
and also the point with polar coordinates 
Corsea: 


GCA RE ES 2 


It is clear from Figure | (and Figure 2) that the pomt with polar coordinates 
(r,@) has cartesian coordinates (x, y) given by 


y= COSO, y=rsin? 


FIGURES 


(a) 


(b) 
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Conversely, if a point has cartesian coordinates (x, y), then (any of) its polar co- 


ordinates (1, @) satisfy 


ro=tvx74 y? 


) 


neds ifx 0) 
ye 

Now suppose that f is a function. Then by the graph of f in polar co- 
ordinates we mean the collection of all pomts P with polar coordinates (r, @) 
satisfying r = f(@). In other words, the graph of f in polar coordinates is the 
collection of all points with polar coordinates (f(@), 6). No special significance 
should be attached to the fact that we are considering pairs (f(@), 4), with f (0) 
first, as opposed to pairs (x, f(x)) in the usual graph of f; it is purely a matter of 
convention that r is considered the first polar coordinate and @ is considered the 
second. 

The graph of f in polar coordinates is often described as “the graph of the 
equation r = f(@).” For example, suppose that f is a constant function, f(@) =a 
for all 6. The graph of the equation r = a is simply a circle with center O and 
radius a (Figure 3). ‘This example illustrates, in a rather blatant way, that polar 
coordinates are likely to make things simpler in situations that involve symmetry 
with respect to the origin O. 

The graph of the equation r = @ is shown in Figure 4. ‘The solid line corresponds 
to all values of 6 > 0, while the dashed line corresponds to values of 6 < 0. 


_— 


FIGURE 4 Spiral of Archimedes 


As another example involving both positive and negative r, consider the graph of 
the equation r = cos@. Figure 5(a) shows the part that corresponds to 0 < @ < 2/2 
Figure 5(b) shows the part corresponding to 7/2 < @ < 2; here r < 0. You can 
check that no new points are added for 6 > a or 6 < 0. It is easy to describe 
this same graph in terms of the cartesian coordinates of its points. Since the polar 


coordinates of any point on the graph satisfy 


ri Gos Gf 
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and hence 


re=r cos 6, 


its cartesian coordinates satisfy the equation 
9) 
30> SF we = 5 


which describes a circle (Problem 4-16). [Conversely, it is clear that if the cartesian 
coordinates of a point satisfy x? + y* = x, then it lies on the graph of the equation 
r= cosy 

Although we’ve now gotten a circle in two different ways, we might well be 
hesitant about trying to find the equation of an ellipse in polar coordinates. But 
it turns out that we can get a very nice equation if we choose one of the foci as 
the origin. Figure 6 shows an ellipse with one focus at O, with the sum of the 
distances of all points from O and the other focus f being 2a. We've chosen f to 
the left of O, with coordinates written as 


(—2ea,0). 


(We have 0 < € < 1, since we must have 2a > distance from f to O). 


(x, y) 


FIGURE 6 
The distance r from (x, y) to O is given by 
(1) r =x? + y’, 
By assumption, the distance from (x, y) to f is 2a — r, hence 


(Qa ay ce eal) sae. 


/ 2! SD) 9 
(2) 4a* — 4ar +r? = x* + 4eax + 4e7a* + y’. 
Subtracting (1) from (2), and dividing by 4a, we get 


5 
a-r=éx+€a, 
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or 
r=a—eéx—€7a 
= (il = e*)a — EX, 
which we can write as 
(3) r=A—ex, for A = (1 —e°)a. 


Substituting r cos @ for x, we have 


r= A—ercos8, 


r(1+ecos@é) =A, 


and thus 
“) ae ; cos 0 
In Chapter 4 we found that 
x2 y2 
(5) oh ae. 


is the equation in cartesian coordinates for an ellipse with 2a as the sum of the 
distances to the foci, but with the foci at (—c, 0) and (c, 0), where 


Since the distance between the foci is 2c, when this ellipse is moved left by c 
units, so that the focus (c, 0) is now at the origin, we get the ellipse (4) when we 
take c = ea or € = c/a (with equation (3) determining A). Conversely, given 
the ellipse described by (4), for the corresponding equation (5) the value of a is 
determined by (3), 


and again using c = €a, we get 


Nalin Aseria YO 5 : 
V1 —e 


Thus, we can obtain a and b, the lengths of the major and minor axes, immediately 
from ¢ and A. 


The number 


the eccentricity of the ellipse, determines the “shape” of the ellipse (the ratio of the 
major and minor axes), while the number A determines its “size,” as shown by (4). 
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If two pomts have polar coordinates (71, 6)) and (rz, 62), show that the dis- 
tance d between them is given by 


d* = fe + roe — 2r\r2cos(O; — 6). 
What does this say geometrically? 
Describe the general features of the graph of f in polar coordinates if 
(i) (fis even. 


(ii) fis odd. 
(iii) f(@)= f(@+z7). 


Sketch the graphs of the following equations. 


C7 —asine. 

(ii) + =asec@. Hint: It is a very simple graph! 
(in) r = cos 20. Good luck on this one! 

(vie —2c0s 30. 

Sea) 60s 20 |. 

(Vij —siGos 30 |. 


Find equations for the cartesian coordinates of points on the graphs (i), (1) 
and (ii) in Problem 3. 


Consider a hyperbola, where the difference of the distance between the two 
foci is the constant 2a, and choose one focus at O and the other at (—2ea, 0). 
(In this case, we must have ¢ > 1). Show that we obtain the exact same 
equation in polar coordinates 


A 
r= ————_ 
}+eéecosé 


as we obtained for an ellipse. 


Consider the set of points (x, y) such that the distance (x, y) to O is equal to 
the distance from (x, y) to the line y = a (Figure 7). Show that the distance 
to the line is a — r cos @, and conclude that the equation can be written 


a=r(1+cos@). 
Notice that this equation for a parabola is again of the same form as (4). 


Now, for any A and e, consider the graph in polar coordinates of the equa- 


tion (4), which implies (3). Show that the pomits satisfying this equation satisfy 
(l= exe y? = A* —2Aex. 


Using Problem 4-16, show that this is an ellipse for ¢ < 1, a parabola for 
€ = 1, and a hyperbola for e > I. 
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8. (a) Sketch the graph of the cardwid r = 1 — sin@. 
(b) Show that it is also the graph of r = —1 — sin@. 
(c) Show that it can be described by the equation 


Se OEY 

and conclude that it can be described by the equation 
2 D 2 2 2 
Cigieia Weng) Se a 


9. Sketch the graphs of the following equations. 


P GQ) r=l1- 5sind. 
(i) « n= 2smie: 
dq d (i) r=2+cosé. 
10. (a) Sketch the graph of the /emniscate 
(—a, 0) (a, 0) r? = 2a’ cos 20. 
(b) Find an equation for its cartesian coordinates. 


(c) Show that it is the collection of all points P in Figure 8 satisfying 
didz =a’. 
(d) Make a guess about the shape of the curves formed by the set of all P 
cuits satisfying d)dy = b, when b > a?.and when b < a’. 


CHAPTER 


PROVISIONAL DEFINITION 


LIMITS 


The conecpt ofa limit is surely the most important, and probably the most difficult 
one in all of calculus. “Che goal of this chapter is the definition of limits, but we 
are, once more, going to begin with a provisional definition; what we shall define 
is not the word “limit” but the notion of a function approaching a limit. 


The function f approaches the limit / near a, if we can make f(x) as close as we 
like to 7 by requiring that x be sufficiently close to, but unequal to, a. 


Of the six functions graphed in Figure |, only the first three approach / at a. 
Notice that although g(a) is not defined, and f(a) is defined “the wrong way,” it 
is still true that g and h approach / near a. This is because we explicitly ruled 
out, in our definition, the necessity of ever considering the value of the function 
at ait is only necessary that f(x) should be close to / for x close to a, but unequal 
toa. We are simply not interested in the value of f(a), or even in the question of 
whether f(a) is defined. 
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One convenient way of picturing the assertion that f approaches / near a is 
provided by a method of drawing functions that was not mentioned in Chapter 4. 
In this method, we draw two straight lines, each representing R, and arrows from 
a point x in one, to f(x) in the other. Figure 2 illustrates such a picture for two 
different functions. 
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Now consider a function f whose drawing looks like Figure 3. Suppose we ask 
that f(x) be close to /, say within the open interval B which has been drawn 
in Figure 3. ‘This can be guaranteed if we consider only the numbers x in the 
interval A of Figure 3. (In this diagram we have chosen the largest interval which 
will work; any smaller interval containing a could have been chosen instead.) Ifwe 


ee “a 
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FIGURE 3 FIGURE 4 


choose a smaller interval B’ (Figure 4) we will, usually, have to choose a smaller A’, 
but no matter how small we choose the open interval B, there is always supposed 
to be some open interval A which works. 

A similar pictorial interpretation is possible in terms of the graph of f, but in 
this case the interval B must be drawn on the vertical axis, and the set A on the 
horizontal axis. ‘The fact that f(x) is in B when x is in A means that the part of the 
graph lying over A is contained in the region which is bounded by the horizontal 
lines through the end points of B; compare Figure 5(a), where a valid interval A 
has been chosen, with Figure 5(b), where A is too large. 


(a) 
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‘To take a specific simple example, let’s consider the function f(«) = 3.x with 
a = 5 (Figure 6). Presumably f should approach the limit 15 near 5—we ought 
to be able to get f(x) as close to 15 as we like if we require that x be sufficiently 
close to 5. ‘To be specific, suppose we want to make sure that 3.x is within ih of 
15. ‘This means that we want to have 


| l 
IS — — < 3x < 154+ — 
5 10 ce Rie <2 ae 10° 


which we can also write as 


10 10 
‘To do this we just have to require that 
l | 
ae 
50a nay 


or simply |x —5| < 0: ‘There is nothing special about the number bb: It is just as 


easy to guarantee that [3x — 15| < Ww: simply require that |x — 5| < WW: In fact, 
if we take any positive number € we can make [3.x — 15| < € simply by requiring 
that’ |a="Sitete /3. 

There’s also nothing special about the choice a = 5. It’s just as easy to see that 
f approaches the limit 3a at a for any a: To ensure that 


[3x —3al| <e 


we just have to require that 


a ea 
ROS | ee ee 
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Naturally, the same sort of argument works for the function f(«) = 3,000,000... 
We just have to be 1,000,000 times as careful, choosing |x — a| < ¢/3,000,000 in 
order to ensure that | f(x) — a| < e. 

The function f(x) = x? is a little more interesting. Presumably, we should be 
able to show that f(*) approaches 9 near 3. This means that we need to show 
how to ensure the inequality 


Ix? —9\<e 


for any given positive number ¢ by requiring |x — 3] to be small enough. ‘The 
obvious first step 1s to write 


[x* — 9] = |e — 3ii- [a + 3]. 


which gives us the useful |x — 3] factor. Unlike the situation with the previous 
, which isn’t a convenient constant 


examples, however, the extra factor here is |« +3 
like 3 or 3,000,000. But the only crucial thing is to make sure that we can say 
something about how big |x + 3] is. So the first thing we'll do is to require that 
|x — 3] < 1. Once we've specified that_|y—3))< 1, on 2 < » <4, we have 
5 <x+3 <7 and we've guaranteed that |x + 3] < 7. So we now have 
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b a) q 5 
which shows that we have |x- — 9| < é for |x — 3] < e/7, provided that we've 
also required that |x — 3| < 1. Or, to make it look more official: we require that 


|x — 3| < min(e/7, 1). 


The inital specification |x — 3] < 1 was simply made for convenience. We 


could just as well have specified that |x — 3] < is orale — 3) JO or ai "other 
convenient number. ‘To make sure you understand the reasoning in the previous 
paragraph, it is a good exercise to figure out how the argument would read if we 
chose |x — 3| < 10. 

Our argument to show that f approaches 9 near 3 will basically work to show 
that f approaches a? near a for any a, except that we need to worry a bit more 


about getting the proper inequality for |x + a|. We first require that |x — a| < 1, 
again with the expectation that this will ensure that |x + a| is not too large. In 


fact, Problem 1-12 shows that 
lx| — la] < |~w -—a| < 1, 


sO 


Ix| < 1+ fal, 


and consequently 


lx +a] < |x| + la| < 2Ja|+ 1, 
so that we then have 


9 9) 
Ix“ —a*| = |x —a|- |x +4 
< |x —al|-(Qla|+ 1), 


which shows that we have |x —a?| < ¢ for [x —a| < é/(2|a|+ 1), provided that we 
also have |x — a| < 1. Officially: we require that |x — a| < min(e/(2\a| + 1), 1). 

In contrast to this example, we'll now consider the function f(x) = 1/x (for 
x #0), and try to show that f approaches |/3 near 3. This means that we need 
to show how to guarantee the mequality 


for any given positive number € by requiring |x — 3| to be small enough. We begin 
by writing 


giving us the nice factor |x — 3], and even an extra ; for good measure, along with 
the problem factor 1/|x|. In this case, we first need to make sure that |x| isn’t too 
small, so that 1/|x| won't be too large. 


We can first require that |x — 3] < 1, because this gives 2 < x < 4, so that 
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which not only tells us that — < a but also that x > 0, which is important in 


ex. 2 
] l 
order to conclude that erat We now have 
l ] | | ] 
—~—-|= -=-—-|x-3 —lx — 3], 
x q Sa eB a al 


which shows that we have |I1/x — 1/3] < ¢ for |x — 3| < 6e, provided that we’ve 
also required that |x — 3] < 1. Or, to make it look official again: we require that 
|x — 3| < min(6e, 1). 


If we instead wanted to show that f approaches —1/3 near —3, we would begin 
by stipulating that |~ — (—3)| < 1, giving —4 < x < —2, once again implying that 
[1 /x| < 1/2, so that everything works as before. 

To show in general that f approaches 1/a near a for any a we proceed in 
basically the same way, except that, again, we have to be a little more careful 
in formulating our initial stipulation. It’s not good enough simply to require that 
|x —a| should be less than 1, or any other particular number, because if a is close to 
0 this would allow values of x that are negative (not to mention the embarrassing 


possible values for x ee ae i 
possibility that x = 0, so that f(x) isn’t even defined!), 


- A The trick in this case is to first require that 
De o 
———= In—-al< >; 
a= ae 0 
Ero in other words, we require that x be less than half as far from 0 as a (Figure 7). 


You should be able to check first that x 4 0 and that 1/|x| < 2/l/a|, and then work 
out the rest of the argument. 

With all the work required for these simple examples, you may have begun to 
quail at the prospect of tackling even more complicated functions. But that won't 
really be necessary, since we will eventually have some basic theorems that we can 
rely on. Instead of worrying about the unpleasant algebra that might be involved 
in functions like f(x) = x? or f(x) = 1/x3, we'll turn our attention to some 
examples that might appear to be even more frightening. 

Consider first the function f(x) = xsinI/x (Figure 8). Despite the erratic 
behavior of this function near 0 it 1s clear, at least intuitively, that f approaches 
/ = 0 near a = 0 (remember that our provisional definition specifically exempts 


1 


ae 


x =a from consideration, so it doesn’t matter that this function isn’t even defined 


SO as1n 
at 0). We want to show that we can get f(x) = x sin 1/x as close to O as desired 


if we require that x be sufficiently close to 0, but 4 0. In other words, for any 
number € > 0, we want to show that we can ensure that 


Ps 


fC O| Sx sin) <5 
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FIGURE 8 


by requiring that |x| = |x —O} is sufliciently small (but 4 0). But this is easy. Since 


<b. ror qld) <p = 10h 
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we have 


==) 


: for all. 0; 


% sin — 
G 


so we can make |x sin 1/x| < e€ simply by requiring that |x| < ¢ and ¥ 0. 


~ ° WSS . . , 
For the function f(x) = x* sin 1/x (Figure 9) it seems even clearer that f ap- 
proaches 0 near 0. If, for example, we want 


oar 
10 


then we certainly need only require that |x| < is and x 4 0, since this implies 


F 
that |x-| < and consequently 
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100 


l 


== <S 4 
100 —=—-:10 


. 
< |x"| < 


eet tal 
x~ sin — 
x 


lan : 
(We could do even better, and allow |x| < 1/v10 and x $ O, but there is no 
particular virtue in being as economical as possible.) In general, if e > 0, to 
ensure that 


we need only require that 
olve<ven valid! . xO) 


provided that ¢ < 1. If we are given an € which is greater than | (it might be, even 
though it is “small” e’s which are of interest), then it does not suffice to require 
that |x| < ©, but it certainly suffices to require that |x| < 1 and x £0. 


As a third example, consider the function f(x) = |x|sin1/x (Figure 10). In 
order to make | |x| sin 1/x| < € we can require that 


Ix] <e* and x = =) 


(the algebra is left to you). 
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Finally, let us consider the function f(x) = sin 1/x (Figure 11). For this function 
it 1s false that f approaches 0 near 0. This amounts to saying that it is not true 
for every number ¢ > 0 that we can get | f(x) — O| < ¢ by choosmg x sufficiently 
small, and 4 0. ‘To show this we simply have to find one ¢€ > O for which the 
condition | f(x) — O| < ¢ cannot be guaranteed, no matter how small we require 


l 


|x| to be. In fact, ¢ = 5 will do: it is impossible to ensure that | f(x)| < Ls 


matter how small we require |x| to be; for if A is any interval containing 0, there 


is some number x = 1/(42 + 2nz) which is in this interval, and for this x we have 


fas 


roy! 
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This same argument can be used (Figure 12) to show that f does not approach 
any number near 0. ‘To show this we must again find, for any particular number J, 
some number € > O so that | f(«) —/| < € is not true, no matter how small x is 
required to be. The choice ¢ = 5 works for any number /; that is, no matter how 
small we require |x| to be, we cannot ensure that | f(x) —/| < 5. The reason ts, 
that for any interval A containing 0 we can find both x; and x2 im this interval 
with 


Ves) = l and F (x2) — = | 


namely 
| ] 
=< and i 
sm + 2n7 ai 4 27 
for large enough n and m. But the interval from / — to tee L cannot contam 
both —1 and I, since its total length is only 1; so we cannot have 


|l —/| <4 and also |—1 —/| < 5. 


no matter what / 1s. 


The phenomenon exhibited by f(v) = sin 1/x near 0 cau occur m many ways. 
If we consider the function 
QO, x irrational 


fa) = 


l. « YationaAl 


Fa GR 13 


fe —iex > 0 


oor — 1, x= 0 
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then, no matter what a is, f does not approach any number / near a. In fact, we 


cannot make | f(x) —/| < f no matter how close we bring x to a, because in any 


interval around a there are numbers x with f(«) = 0, and also numbers x with 
f(x) = 1, so that we would need |O —/| < i and also |I —/| < i 

An amusing variation on this behavior is presented by the function shown in 
Bigtie sl 3: 

oo aes rational 

QO, x irrational. 

The behavior of this function is “opposite” to that of g(x) = sin 1/x; it ap- 
proaches 0 at 0, but does not approach any number at a, if a 4 0. By now you 
should have no difficulty convincing yourself that this is true. 


We conclude with a very simple example (Figure 14): 


=, x <Q 


fa)= IF % =i) 


If a > 0, then f approaches | near a: indeed, to ensure that | f(x) — 1] < e it 
certainly suflices to require that |. — a| <a, since this implies 


=a = + ae 
or Oy 


so that f(x) = |. Similarly, if b < 0, then f approaches —I near b: to ensure 
that | f(x) — (—1)| < € it suffices to require that |x — b| < —b. Finally, as you may 
easily check, f does not approach any number near 0. 


The tme has now come to pomt out that of the many demonstrations about 
limits which we have given, not one has been a real proof. The fault hes not 
with our reasoning, but with our definition. If our provisional definition of a 
function was open to criticism, our provisional definition of approaching a limit 
is even more vulnerable. ‘This definition is simply not sufficiently precise to be 
used in proofs. It is hardly clear how one “makes” f(x) close to / (whatever 
“close” means) by “requiring” x to be sufficiently close to a (however close “sufh- 
ciently” close is supposed to be). Despite the criticisms of our definition you may 
feel (I certainly hope you do) that our arguments were nevertheless quite convine- 
ing. In order to present any sort of argument at all, we have been practically forced 
to invent the real definition. It is possible to arrive at this definition in several steps, 
each one clarifying some obscure phrase which still remains. Let us begin, once 
again, with the provisional definition: 


The function f approaches the limit / near a, if we can make f(x) as close 
as we like to / by requiring that x be sufficiently close to, but unequal to, a. 


The very first change which we made in this definition was to note that making 
f(x) close to / meant making | f(v) —/| small, and similarly for x and a: 
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The function f approaches the limit / near a, if we can make |f(«) —/| as 
small as we like by requiring that |x — a| be sufficiently small, and x 4 a. 


‘The second, more crucial, change was to note that making | f(x) — /| “as small as 
we hke” means making | f(«) —/| < e for any ¢ > 0 that happens to be given us: 


The function f approaches the limit / near a, if for every number ¢ > O we 
can make 


X32 Ge 


f(x) —1| < e by requiring that |x — a| be sufficiently small, and 


‘There is a common pattern to all the demonstrations about limits which we have 
given. Kor each number € > 0 we found some other positive number, 6 say, with 
the property that if x # a and |x —a| < 46, then | f(x) —1| < e. For the function 
FQ) = xsurl/x Wath a =10,-2 = 0); the number 6 was justihé muniberse; 
for 7 j= J/|x]sin I/x, it was e7; for f(x) = x? it was the minimum of | and 
€/(2ja| + 1). In general, it may not be at all clear how to find the number 4, 
given €, but it is the condition |x —a| < 6 which expresses how small “sufficiently” 
small must be: 


The function f approaches the limit / near a, if for every ¢ > 0 there is some 
6'> O'sueh that, 'for alli |x =.a|<% andia. a, then |f (*) —2| = &. 


This is practically the definition we will adopt. We will make only one trivial 
change, noting that * 
lx —a| <6.” 


x —a| < 6 and x #a” can just as well be expressed “O < 


The function f approaches the limit / near a means: for every ¢ > O there 


is some 6 > O such that, for all x, if O < |x —a| <6, then | f(x) —/| <e. 


This definition is so important (everything we do from now on depends on it) that 
proceeding any further without knowing it is hopeless. If necessary memorize it, 
like a poem! That, at least, is better than stating it incorrectly; if you do this you 
are doomed to give incorrect proofs. A good exercise in giving correct proofs is to 
review every fact already demonstrated about functions approaching limits, giving 
formal proofs of each. In most cases, this will merely mvolve a bit of rewording 
to make the arguments conform to our formal definition all the algebraic work 
has been done already. When proving that f does nod approach / at a, be sure to 
negate the definition correctly: 


If it is wof true that 


for every € > 0 there is some 6 > 0 such that, for all x, if O < |x —a| < 4, 
then | f(x) —1] < e, 


then 
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there is some € > O such that for every 5 > O there 1s some x which satisfies 
O < |x —a| <6 but not |f(x)-l1| <e. 


Thus, to show that the function f(x) = sin 1/x does not approach 0 near 0, we 
consider ¢ = 5 and note that for every 6 > 0 there is some x with 0 < |x —O| < 6 
but not | sin 1/x —O| < 4—namely, an x of the form 1/(7/2 + 2n7), where n is 
so large that 1/(@/2 + 2nn) <6. 

As a final illustration of the use of the definition of a function approaching a 
limit, we have reserved the function shown in Figure 15, a standard example, but 


one of the most complhcated: 


0, x wrational, 0 =a = | 
ig, x« — pg in lowest terms, 0 <= x = I; 


fa= 


(Recall that p/q is in lowest terms if p and gq are integers with no common factor 
and q > 0.) 


° 0, x irrational 


Ni 


[BY 
—, x= — in lowest terms 
q q 
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Por any number a, with 0 <a < 1, the function f approaches 0 at a. To prove 
this, consider any number ¢ > 0. Let 7 be a natural number so large that 1/n < e. 
Notice that the only numbers x for which | f(x) — O| < € could be false are: 


De oie Oe ee | n— | 


he BG Sg Titian pall yall 


(If @ is rational, then a might be one of these numbers.) However many of these 


numbers there may be, there are, at any rate, only finitely many. Therefore, of all 


these numbers, one is closest to a; that is, |p/q —a| 1s smallest for one p/q among 
these numbers. (If a happens to be one of these numbers, then consider only the 
values |p/q — a| for p/q #.a.) This closest distance may be chosen as the 6. For 


if O < |x —a| < 6, then x is not one of 
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“ < 
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and therefore | f(x) — O| < e as true. This completes the proof. Note that our 
description of the 6 which works for a given € is completely adequate— there is no 
reason why we must give a formula for 6 in terms of ¢€. 

Armed with our definition, we are now prepared to prove our first theorem; you 
have probably assumed the result all along, which is a very reasonable thing to do. 
This theorem is really a test case for our definition: if the theorem could not be 
proved, our definition would be useless. 


A function cannot approach two different limits near a. In other words, if f 
approaches / near a, and f approaches m near a, then / =m, 


Since this is our first theorem about limits it will certainly be necessary to translate 
the hypotheses according to the definition. 


Since f approaches / near a, we know that for any ¢ > 0 there is some number 
5, > 0 such that, for all x, 


if 0 < |x — al=0), then |f @)—adil| ae. 


We also know, since f approaches m near a, that there is some 462 > 0 such that, 
ior allie. 


if O < |x —a| < 59, then | f(x) —m| <e. 


We have had to use two numbers, 6; and 52, since there is no guarantee that the 4 
which works in one definition will work in the other. But, in fact, it is now easy to 
conclude that for any € > 0 there is some 6 > O such that, for all x, 


if 0 < |x — a| < 4, then | f(x) —/| < € and | f(x) —m| < e; 


we simply choose 6 = min(é1, 42). 

‘To complete the proof we just have to pick a particular e > 0 for which the two 
conditions 
\f(x) —m|<e 


\f(x)-I| <e and 


cannot both hold, if / #4 m. The proper choice is suggested by Figure 16. If 
1 Am, so that |/ —m| > 0, we can choose {/ — m|/2 as our e. It follows that there 
is a 6 > O such that, for all x, 


[1 — | 
== 


|! — 22? | 


a) 


pan 


ifO < |x —a| <4, then | f(x) -I{ < 


and | f(x) —m| < 
‘Vhis implies that for 0 < [x — a| < 6 we have 


J§ =amel = — fr) + fo) —Tel = — fais a) — mal 


l/—m| |l—m| 
Pee i eee 


a contradiction. J 
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The number / which f approaches near a is denoted by lim f(x) (read: the limit 


Me! 


of f(x) as x approaches a). ‘This definition is possible only because of Theorem 1, 
which ensures that lim f(«) never has to stand for two different numbers. The 


amar ate 
equation 


lim Os) = | 


Xa 


has exactly the same meaning as the phrase 
f approaches / near a. 


The possibility stl remains that f does not approach / near a, for any /, so that 
lim f(x) =/ is false for every number /. This is usually expressed by saying that 


Set 


“lim f(x«) does not exist.” 


pXceae C2, 


Notice that our new notation introduces an extra, utterly irrelevant letter x, 
which could be replaced by rt, y, or any other letter which does not already 
appear— the symbols 


lial f(x), lan 71). lim f(y). 
ie 


Xa ya 


all denote precisely the same number, which depends on f and a, and has nothing 
to do with x, 7, or y (these letters, in fact, do not denote anything at all). A more 
logical symbol would be something like lim f, but this notation, despite its brevity, 
: i 
is so infuriatingly rigid that almost no one has seriously tried to use it. The notation 
lim f(x) is much more useful because a function f often has no simple name, even 
i oral : 
though it might be possible to express f(x) by a simple formula involving x. Thus, 
the short symbol 


3 > . 
lim (x~ + sin.) 
Kaa 


could be paraphrased only by the awkward expression 


lim f, where f(x) = x7 + sinx. 


a 
Another advantage of the standard symbolism is illustrated by the expressions 


lim x + P, 


Gal | 


lhivag Pe. 


[oa 
The first means the number which f approaches near a when 
: 3 . 
Loria ee tor. alley 
the second means the number which f approaches near a when 
; 3 : 
f(t) =x4+t, forall tr. 
You should have little difficulty (especially if you consult Theorem 2) proving that 


lim x + a + Pr, 


Xa 


lim x + ay, + a, 


ta 
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These examples illustrate the main advantage of our notation, which is its flex- 
ibility. In fact, the notation lim f(x) is so flexible that there is some danger of 


ot Aen 

forgetting what it really means. Here is a simple exercise in the use of this no- 
tation, which will be important later: first interpret precisely, and then prove the 
equality of the expressions 

lun f(x) and Im f(a+h). 

xa h—0 

An important part of this chapter is the proof of a theorem which will make 

it easy to find many limits, as we promised long ago. The proof depends upon 
certain properties of inequalities and absolute values, hardly surprising when one 
considers the definition of limit. Although these facts have already been stated in 
Problems 1-20, 1-21, and 1-22, because of their importance they will be presented 
once again, in the form ofa lemma (a lemma is an auxiliary theorem, a result that 
justifies its existence only by virtue of its prominent role in the proof of another 
theorem). ‘The lemma says, roughly, that if x is close to x9, and y 1s close to yo, 
then x + y will be close to x9 + yo, and xy will be close to x9y9, and 1/y will be 
close to 1/yg. ‘This intuitive statement is much easier to remember than the precise 
estimates of the lemma, and it is not unreasonable to read the proof of Theorem 2 
first, in order to see just how these estimates are used. 


(1) If 


is) 


e 
|x — xo| < 5 and |y — yol < a 


t 


then 
[Com i a (xgicta Yo) | =e: 
(2) If 
5 S 
x — xo| < min { 1, ————— } and ly-—yo|< ; 
eee ( 2(Iyol + 7 PS 280+ D 
then 


lxv — xoyo| < €. 


(3) If yo 4 O and 


F 
. { lyol elyol” 
ly — yo| < min ap ag 


then y 4 0 and 
I | 


Ay YO 


<< Bo 


(1) lv =F y) = (xo + ¥o)| = | = x0NFF Cy = Yo) 


e 
[= 0 en rete 


- 


lA 
ye) 


(2) Since [x — x9| < | we have 


lx = ro] = [eeeeeholle cael 


5. Limits 103 


so that 
belie Le xo: 


Thus 


Ixy — xoyol = |x(y — yo) + yo(x — xo)| 
< |x| - ly — yol + lyol - lx — xol 


3 e 
< (1 + |xo|) - ———— + | vo | - — 
Tee 6° Mea 
5 is € 
<— = — = £, 
Da) 
(3) We have 
lyo| 
lyol — lyl < ly — yol < er 
so |y| > |yo|/2. In particular, y 4 0, and 
l 2 
lvl lyol 
Thus : 
Ags > all lyo — YI 2D 1 elyol* 
SS =| = Zi yp =, | 
y yo lyl-lyol lyol lyol 2 


THEOREM 2 If lim f(x) =/ and lim g(x) = m, then 


(1) lim(f + g)(4) =4 +m; 
(2) lim(f -g)@) =1-m. 


Moreover, if m 4 0, then 


l l 
(Gy likan (=) (x) =—. 
x>a \ g m 


PROOF ‘The hypothesis means that for every ¢ > O there are 5;,462 > O such that, for 
all x, 
if 0 < |x —a| < 6), then | f(x) —1| <e, 
and if 0 < |x —a| < do, then |g(x) — m| < «. 


This means (since, after all, ¢/2 is also a positive number) that there are 6), 62 > 0 
such that, for all x, 


if 0 < |x —a| < 6), then | f(x) —l| < = 
and if O < |x —a| < do, then |g(x) — m| < - 

Now let 6 = min(6j, 462). If 0 < |x —a| < 6, then O < |x —a| < 6, and 

0 < |x —a| < 49 are both true, so both 


| f(x) -—l| < = and |g(x) —m| < = 
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are true. But by part (1) of the lemma this implies that |(f + g)(x) — (/+m)| < e. 
This proves (1). 

‘To prove (2) we proceed similarly, after consulting part (2) of the lemma. If 
€ > O there are 51, 62 > O such that, for all x, 


€ 
if O —a| < 4), tl —/ in { 1, ————— }, 
pti) <=) [55 | iy then |fiGs) |< min ( saat) 


Ee 
ange at O.— |x, —donthen ie) — 7 ———— 
=? | < 62, then |g(x) | XUN + D 


Again let 6 = min(6), 52). If 0 < |x —a| <4, then 


S 


| f (x) —/| < min (1. aaa 


) and Lee) ergs eae 
2(It| + 1) 


So, by the lemma, |(f - g)(x) —1-m| < ¢, and this proves (2). 


Finally, if ¢ > 0 there is a 5 > O such that, for all x, 


D, 
if O < |x —a| <6, then |g(x) — m| < min (4 “s : 


But according to part (3) of the lemma this means, first, that g(x) 4 0, so (1/g)(x) 
makes sense, and second that 

1 l 

g m 


SS Ge 


This proves (3). J 


Using Theorem 2 we can prove, trivially, such facts as 


oe XP Ix? 4a? 4-7Ja? 

lint SS aes 

Xa) Ger ] a-+ | 
without going through the laborious process of finding a 6, given an ¢. We must 
begin with 


lim 7 = 7, 
> ek 
liny ty 
2. — fe! 
lin! =a, 
ca 


but these are easy to prove directly. If we want to find the 6, however, the proof of 
‘Theorem 2 amounts to a prescription for doing this. Suppose, to take a simpler 
example, that we want to find a 6 such that, for all x, 


if O < |x —a| < 6, then |x? +x — (a° +a)| <e. 
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Consulting the proof of Theorem 2(1), we see that we must first find 6; and 62 > 0 
such that,.for all’, 


aya » 9) 
if O < |x —a| < dy, then |x* — a‘*| 
and if O < |x —a| < 49, then |x —a| < 


ee : : é 2 D c : 
Since we have already given proofs that lim x7 = a~ and lim x = a, we know how 


Jats | 36 {el 


to do this: 


tw] 


5) = 
Thus we can take 


€ 
a é 
“2lay-ely 2 


If a 40, the same method can be used to find a 6 > O such that, for all x, 


5 = min(6), 62) = min {mm | 1 


if) O <a| a | =< 0, then 


= = 


The proof of Theorem 2(3) shows that the second condition will follow if we find 
a6 > 0 suchithat tor ally, 
9 / 
a yee et eels 
if 0 < |x —a| < 6, then |x- — a*| < min aoa 


~ _ 


. 


Thus we can take 


2) 4 
min ls ele) 
i 
6 =min { I, 
2\a|+ | 


Naturally, these complicated expressions for 6 can be simplified considerably, after 
they have been derived. 

One technical detail m the proof of Theorem 2 deserves some discussion. In 
order for lim f(x) to be defined it is, as we know, not necessary for f to be defined 


itl 
at a, nor is it necessary for f to be defined at all pomts x 4 a. However, there 
must be some 6 > 0 such that f(x) ts defined for x satisfying 0 < |x —a| < 6; 
otherwise the clause 


aie a ali< o, then lif @) sila? 


would make no sense at all, since the symbol f(*) would make no sense for 
some x's. If f and g are two functions for which the definition makes sense, 
it is easy to see that the same ts true for f + g and f +g. But this is not so 
clear for 1/g, since 1/g 1s undefined for x with g(x) = 0. However, this fact gets 
established in the proof of Theorem 2(3). 
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There are umes when we would like to speak of the limit which f approaches 
at a, even though there is no 6 > O such that f(x) is defined for x satisfying 
QO < |x ~a| < 5. For example, we want to distinguish the behavior of the two 
functions shown in Figure 17, even though they are not defined for numbers less 
than a. For the function of Figure 17(a) we write 


lion f(a or “lint (ate 


x—at xa 


(The symbols on the left are read: the hit of f(¥) as x approaches a from above.) 
These “limits from above” are obviously closely related to ordinary limits, and the 
definition is very similar: lim f(+) =/ means that for every ¢ > 0 there is a 6 > 0 


x—ar 


Such @uatedor all x, 
if O<x«—a <4, then |f(x)-1| <e. 


(The condition “O < x —a < 8” is equivalent to “O < |x — al <6 and x > a.”) 


“Limits from below” (Figure 18) are defined similarly: lm f(x) = / (or 
> Ce 
hn fi@) = Himeans that forievery eee O theress avd) > 90 such that, tor 
xta ‘ 
all x, 


if 0 <a —x =0,.then"|f @).— 1] <e. 


It is quite possible to consider limits from above and below even if f is defined 
for numbers both greater and less than a. ‘Thus, for the function f of Figure 14, 
we have 


him, 1) — and lin ce — — 


It is an easy exercise (Problem 29) to show that lim f(x) exists if and only if 


hina Ct 


him f(x) and lm f(x) both exist and are equal. 


x—at x a7 


Like the definitions of limits from above and below, which have been smugeled 
into the text informally, there are other modifications of the limit concept which 
will be found useful. In Chapter 4 it was claimed that if x is large, then sin [/x is 
close to QO. ‘This assertion is usually written 


Munalsin el /xte= Q. 


¥ > @O 


Vhe symbol lim f(x) is read “the limit of f(+) as « approaches 00,” or “as x 
v= OO 
becomes infinite.” and a limit ofthe form him f(x) is often called a limit at infinity. 
X QO 
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Figure 19 illustrates a general situation where lim f(x) =/. Formally, lim f(x) = 
; X>CO Xx 0O 


/ means that for every ¢ > O there is a number WN such that, for all x, 
if josSoNe then | fiG@)=—T| =e. 


The analogy with the definition of ordinary limits should be clear: whereas the 
condition “OQ < |x — a| < 6” expresses the fact that x is close to a, the condition 
“x > N” expresses the fact that x is large. 


FIGURE 19 


We have spent so little time on limits from above and below, and at infinity, 
because the general philosophy behind the definitions should be clear if you un- 
derstand the definition of ordinary limits (which are by far the most important). 
Many exercises on these definitions are provided in the Problems, which also con- 
tain several other types of limits which are occasionally useful. 


PROBLEMS 


1. Find the following limits. (These limits all follow, after some algebraic ma- 
nipulations, from the various parts of Theorem 2; be sure you know which 
ones are used in each case, but don’t bother listing them.) 


foal 
(i)  lim- 
x>1 x + | 
ii) x =8 
ul im 
x>2 x—-2 
Sole eg 
(ui) lm , 
x>3 x —2 
; xn ve 
Gv) lm 
Pa CS y 
x" — y" 
(v) hm —, 
paca 
= ath—Ja 
(vi) lim ———————_.. 
h>0 h 


2. Find the following limits. 


a) =lim 
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=5; 


il lim 

( x0 XG 

am ae. Lo-v1—x? 
i) lm ; 
( ) x0 x? 


In each of the following cases, determine the limit / for the given a, and 
prove that it is the limit by showing how to find a 6 such that | f(x) —1| < € 
for all x satisfying 0 < |x —a| <6. 


he) = x [3 — cos(x7)], a) 
(ie aCe) = «6-50 — 2 bg — 2 
(i) SEs ive a=. 

x 
Gv) fG@)=x*, arbitrary a. 


seal 
GO) fG@)=2t = aw 
x 


x 
vl) f(x) = — ——, a= 0. 
~ 2 — sin? x 
(oat) C2 Aes it ere 0 
(Wainy fi )-= J/x, a= i. 
For each of the functions in Problem 4-17, decide for which numbers a the 
limit lim f(x) exists. 


(a) Do the same for each of the functions in Problem 4-19. 
(b) Same problem, if we use infinite decimals ending in a string of 0’s 
instead of those ending in a string of 9s. 


Suppose the functions f and g have the following property: for all ¢ > 0 
ana all. 


9) 


if O < |x —2| < sin? (5) +e, then | f(x) — 2| < e, 
if 0 < |x —2| < &”, then lge(x) —4| <e. 
For each ¢ > O find a 6 > O such that, for all x, 


a) if O< |x —2| <6, then |f(x~)+g@)—6| <e. 
(i) aif O < |x —2| <6, then |f(x)g(@%) — 8| <e. 


l 
ii) if O< |x —2 5, the = S| 2 
(an) at (Oa) | < yen nes i 
if fie). 1 | 
(iv f 0 < |x —2| < 4d, then —— 
iv) if 0 < fe —2) <8, then | = 5 


Give an example of a function f for which the following assertion 1s false: 
If |f(x) —1l| < e when O < |x —a| < 6, then |f(x) —1| < ¢/2 when 
0 < |x —a| < 6/2. 
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(a) If lim f(x) and lm g(x) do not exist, can lim| fv) + g(x)] exist? Can 


Siar at § 


lim f(«)g(x) exist? 
Gm afd 


(b) af lim f(x) exists and lim[ f(x) + g(x)] exists, must lim g(x) exist? 
a 8 | tes Fi 


(c) mf tin f (x) exists and lim g(x) does not exist, can lim [ f (x)+2(x)] exist? 

(d) If tim f(x) exists and lim f(x)g(x) exists, does it follow that lim g(x) 
exists? . 

Prove that tim Res = anal f(a +h). (This is mainly an exercise in under- 

standing what the terms mean.) 

(a) Prove that lim f(x) =/ if and only if lim[ f(x) — /] = 0. (First see why 
the acai is obvious; then provide a Serer proof. In this chapter 
most problems which ask for proofs should be treated in the same way.) 

(b) Prove that him wie him f(x -a). 

(c) Prove that ue (2) = Ls >). 


(d) Give an example where him i (x) exists, but lim f (x) does not. 
i= cv 


Suppose there is a 6 > O such that f(x) = g(x) when 0 < |x —a| < 6. Prove 

that lim f(x) = lim g(x). In other words, lim f(x*) depends only on the 
xa x—a Xam ed, 

values of f(x) for x near a—this fact is often expressed by saying that limits 

are a “local property.” (It will clearly help to use 6’, or some other letter, 


instead of 4, in the definition of linits.) 
(a) Suppose that f(x) < g(x) for all x. Prove that im f(x) < lm g(x), 
OG APS A= 
provided that these limits exist. 


(b) How can the hypotheses be weakened? 
(c) If f(x) < g(x) for all x, does it necessarily follow that lim f(x) < 


ia Ca 
lim g(x)? 
ita eb 
Suppose that f(x) < g(x) < h(@) and that lim f(x) = lim A(x). Prove that 
A, Gimme ct a | xa 


lim g(x) exists, and that lim g(x) = lim f(x) = lim A(x). (Draw a picture!) 
ie! Pie ae § Ao af | Vata! 


(a) Prove that if hm Tas —N@and b 4 0; then hin f(bx)/x 7) sean 
Write f(bx)/x = b[ f(bx)/bx]. | 
(b) What happens if b = 0? 
(c) Part (a) enables us to find ot (sin 2x)/x m terms of lim (sin.x)/x. Find 
te 


x—0 
this limit in another way. 


Evaluate the following limits in terms of the number aw = lim (sin .x)/x. 
- x0 


F Sain 3% 
G) hm 
x>0 1X 
2 sin ax 
Gr) = lim 


x0 sin bx 
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18. 


19. 


#20: 


oA 


a 
ee smo 2x 
(i) lim 
x0 XG 
: 
2 Sin 2x 
(iv) hm 5 
x0) eon 
_ |—cosx 
(v) lim 5 
x— 0 \C ae 
: tan“ x + 2¥ 
(vi) hm . 
x0 y+ux- 
asin x 


<0") — cosx 
sin(x + A) — sinx 


a 
ie ap 

x°— | 
fix) E sm (x ) 


A) 38! sin x) 
(x) hm ————-. 
“x= (¥ + sInx)- 


/ 3 
(x1) lim (x? — 1)3 sin ( -) 
x — 


Ores 


(a) Prove that if lim f(x) =/, then lim |[f|(x) = [/]. 


EA 


(b) Prove that if lim f(v) = / and lim g(x) = m, then lim max(f, g)(x) = 


ia 


max(/, 7) and similarly for min. 


(a) Prove that lim |/x does not exist, i.e., show that lim 1/x = / is false for 
x0 


Nia 
every number J. 
(b) Prove that lim 1/(x — 1) does not exist. 


x 


Prove that if lim f(*) = /, then there is a number 5 > 0 and a number M 


LS >a 


such that | f(x)| < M if 0 < |x —a| <6. (What does this mean pictorially?) 
Hint: Why does it suffice to prove that /—1 < f(x) < +1 for 0 < |y—a| < 8? 


Prove that af B/G )e—' 0 ifor_ifrational « and) f(+)= 1 for rational x, 
then lim f(x) does not exist for any a. 

Batt! 
Prove that if f(x) =x for rational x, and f(x.) = —~x for irrational x, then 
lim f(x) does not exist if a 4 0. 
ca 


(a) Prove that if lim g(x) = 0) then him e(x) sit | /xa— 0: 
r= x> 
(b) Generalize this fact as follows: If lim p(x) = O'and |A@)| <= M Tor alle, 
x= 


then lim g(x)h(x) = 0. (Naturally it is unnecessary to do part (a) if you 
x>0 : : : 


succeed m doing part (b); actually the statement of part (b) may make it 
easier than (a)— that’s one of the values of generalization.) 


age 


ne2 3. 


MaA: 


Zo: 
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Consider a function f with the following property: if g is any function for 
which lm g(x) does not exist, then lim[ f(x) + g(x)] also does not exist. 
a0 


x—0 


Prove that this happens if and only if lm f(x) does exist. Hint: This is 
x0 

actually very easy: the assumption that hin f(x) does not exist leads to an 
Oo 


immediate contradiction if you consider the right g. 


This problem is the analogue of Problem 22 when f + g is replaced by f -g. 
In this case the situation is considerably more complex, and the analysis 
requires several steps (those in search of an especially challenging problem 
can attempt an mdependent solution). 


(a) Suppose that hm f(x) exists and is 4 0. Prove that if lim g(x) does not 
4 ei — 2 x- 
exist, then hm f(x)g(x) also does not exist. 
x0 
(b) Prove the same result if him | f(x)| = oo. (The precise definition of this 
AS 2 


sort of limit is given in Problem 37.) 
(c) Prove that if neither of these two conditions holds, then there is a function 
g such that lim g(x) does not exist, but lim fr)g@) does exist. 
x0 i 


Hint: Consider separately the following two cases: (1) for some ¢ > 0 
we have |f(x)| > € for all sufficiently small x. (2) For every ¢ > 0, there 
are arbitrarily small x with |f(x)| < ¢. In the second case, begin by 
choosing points x, with |x,| < I/n and |fQ,)| < 1/n. 


Suppose that A, is, for each natural number n, some file set of numbers in 
[O. f], and that A,, and A,, have no members in common if m 4 n. Define 
f as follows: 


fam ne x in A, 


x not in A, for any n. 


Prove that lim f(x) = 0 for all a in [0, 1]. 


Explain why the following definitions of lim f(x) =/ are all correct: 
P=?) 


For every 6 > 0 there is an ¢ > 0 such that, for all x, 


G) af O< |x —a| <e, then |f(x)—-/1| <6. 
Ga it O |x alt= =. then | 7 @) — Ibs 6. 
( 
( 


in) if O < |x —al| <e, then | f(x) -—1| < 56. 


Vv) Ol "5" | = e/ FO then | fy Is 6. 


Give examples to show that the following definitions of lim Ga)! = Pare wot 

correct. ee 

(a) For all 6 > © there is an € > O such that if O < [x —a| < 6, then 
|\f(x) -—1| <e. 

(b) For all ¢ > 0 there is a 6 > O such that if | f(x) —/| < e, then 0 < 
|x —a| <6. 
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30. 


31) 


32% 


oo: 


34. 


35. 


For each of the functions in Problem 4-17 indicate for which numbers a the 
one-sided limits lim f(x) and lim f(x) exist. 


x—at AB a) 
(a) Do the same for each of the functions in Problem 4-19. 
(b) Also consider what happens if decimals ending in 0’s are used instead of 
decimals ending in 9’s, 


Prove that hm f(x) exists if dim, fe) = Inf (a): 


xX=>a rat x a™ 


Prove that 
(1) lmny f(x) = dima f (=x): 
oe mal 
(i) him f(x) = lim, fC). 
(iii) lim f(x?) = lim f(x). 

x0 x= 0+ 
(These equations, and others like them, are open to several interpretations. 
They might mean only that the two limits are equal if they both exist; or that 
ifa certain one of the limits exists, the other also exists and is equal to it; or 
that if either limit exists, then the other exists and 1s equal to it. Decide for 
yourself which interpretations are suitable.) 


Suppose that lim f(x) < lim f(x). (Draw a picture to illustrate this as- 


i Clan x—at 
sertion.) Prove that there is some 5 > 0 such that f(x) < f(y) whenever 
x <a <_yand |x —a| <6 and |y —a| <6. Is the converse true? 


Prove that lim (a,x" + ---+a9)/(By»x" +---+ bo) (with a, 4 O and by, 4 0) 
3 1,8) 


exists rf and only if m > n. What is the limit when m = 1? When m > 1? 


Hint: the one easy limit is lim 1/x* = 0; do some algebra so that this is the 
XO 


only information you need. 


Find the following limits. 


(i as aol x 
x>o «= 5x+6 
a) len sey 
x00 x/ 15 
Gi) lim V¥x?+x-—x 
a5" ame 1) 


x00 (x +sinx)? 
Prove that ‘hime Cl /x) = Imai Cr): 
x— 0+ X00 
Find the followme limits in terms of the number @ = lim(sin.x)/x. 
x 


sin.x 


GQ) lm 
X00 X 
| 


(i) = lam x sin — 
X.—? OO xX. 


36. 


37. 


38. 


Jo: 


40. 


joskannts bs 


Define * im tT eaal> 


(a) Find iim NG =" G0) (Ome 4-19) 
(b) Prove that lm f(x) = iim f (—x). 
(c) Prove that iim. f/x) = lm f(x) 


We define lim f(x) = oo to mean that for all N there is a 6 > O such that, 


for all x, if ‘0. < |x —a| <6, then f(x) > N. (Draw an appropriate picture!) 
(Of course, we may still say that lim f(x) “does not exist” in the usual sense.) 
xa 


(a) Show that lim 1 /G@—3)- =.0o. 


(b) Prove that if f(x) > ¢ > 0 for all x, and lim g(x) = 0, then 
lim f(x)/|g(x)| = 0° 


(a) Define lim f@):= co, and iim f (x) = o&. (Or at least convince your- 


x—at 
self that you could write down the definitions if you had the energy. How 
many other such symbols can you define?) 


(b) Prove that im VEC —"OO: 


(c) Prove that im f(x) = 00 if and only if lm f(1/x) = 00 


Find the following limits, when they exist. 


n) lm xd+ sin’ x) 
Xx—>> CO 


oe ey . Pe) 
i) dnnnay ‘sie a6 
Xx 0CO 


eo Py aoa 
iv) lim x“sin —-. 
x 


x00 
- 
v) lim V¥x*+2x —x. 
Xx—0O 


va) hin G7 2 — / ) 
Peat aed 
(vn) lim 


x>0co X 


(a) Find the perimeter of a regular n-gon inscribed in a circle of radius r. 
[Answer: 2rn sin(z/n).] 
(b) What value does this perimeter approach as n becomes very large? 


(c) What limit can you guess from this? 
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FIGURE 20 


(a) For c > 1, show that c!/" = </c approaches | as n becomes very large. 
Hint: Show that for any ¢ > 0 we cannot have c!/" > 1+ for large n. 
(b) More generally, if c > 0, then c!/" approaches | as n becomes very large. 


After sending the manuscript for the first edition of this book off to the printer, 
I thought of a much simpler way to prove that lim x? = a? and lim x* = 


xa xa 
a>, without going through all the factoring tricks on page 92. Suppose, for 
example, that we want to prove that lim x* = a’, where a > 0. Given 


xa 


€ > 0, we simply let 6 be the minimum of Va? +¢—a and a — Va?—€ 
(see Figure 19); then |x — a| < 5 implies that Va? —e€ < x < Va?+ 6, so 
a* —@ < x2 < a*+<6, or |x* —a?| < «. It is fortunate that these pages had 
already been set, so that I couldn’t make these changes, because this “proof” 
is completely fallacious. Wherein hes the fallacy? 


FIGURE 1 


FIGURE 3 


CHAPTER 


DEFINITION 


CONTINUOUS FUNCTIONS 


If f is an arbitrary function, it is not necessarily true that 


lim f(r) = f(a): 

AO 
In fact, there are many ways this can fail to be true. For example, f might not 
even be defined at a, in which case the equation makes no sense (Figure 1). 


Again, him f(x) might not exist (Figure 2). Finally, as illustrated in Figure 3, 
Sorte 
even if f is defined at a and lim f(x) exists, the limit might not equal f(a). 


Wet #4 


@) ) © 


hiGU RB ie 


We would like to regard all behavior of this type as abnormal and honor, with 
some complimentary designation, functions which do not exhibit such peculiarities. 
The term which has been adopted is “continuous.” Intuitively, a function /f 1s 
continuous if the graph contams no breaks, jumps, or wild oscillations. Although 
this description will usually enable you to decide whether a function is continuous 
simply by looking at its graph (a skill well worth cultivating) it is easy to be fooled, 
and the precise definition is very important. 


The function f is continuous at a if 


lim f(x) = f(a). 


We will have no difficulty finding many examples of functions which are, or are 
not, continuous at some number a—every example involving limits provides an 
example about continuity, and Chapter 5 certainly provides enough of these. 

The function f(«) = sin 1/x is not continuous at 0, because it is not even defined 
at 0, and the same is true of the function g(a) = x sin L/x. On the other hand, if 
we are willing to extend the second of these functions, that is, if we wish to define 


1 be 
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a new function G by 


STING) ae nee 0 


d, i). 


Gu) =| 


then the choice of a = G(O) can be made in such a way that G will be continuous 
at O— to do this we can (if fact, we must) define G(O) = 0 (Figure 4). This sort of 
extension is not possible for f; if we define 


ee | sin lx, bee ay) 


Ge ei 


es) 


then F will not be continuous at 0, no matter what a is, because hm f(x) does 


Se 


not exist. 


The function 


fo 


i x rational 
0, xX irrational 


(a) is not continuous at a, if a 4 QO, since lim f(x) does not exist. However, im x)= 
c S30] ic) 


0 = f(O), so f 1s continuous at precisely one point, 0. 

a i 

khefunetions f(x) = cy 20) andwiG@ ) =x" are continuous av alll nuni- 
bers a, since 


G 
lm {eg hn ¢c =a 
2 Xi X= 
lini gy *— "hn =f = Stay 
ied intel 
ee ee 
heitiee Linx” =e baie 
>a 3g ate! 
Finally, consider the function 
(b) 0) X irrational 


den = 
FIGURE 4 L/@. x = p/q m lowest terms. 


In Chapter 5 we showed that hm f(*) = 0 for all a (actually, only for 0 < a < 1, 


Xia 


but you can easily see that this is true for all a). Since 0 = f(a) only when a is 
irrational, this function is continuous at a if a is irrational, but not if a@ is rational. 


It is even easier to give examples of continuity if we prove two simple theorems. 


THEOREM 1 If f and g are continuous at a, then 


(1) f+ 1s continuous at a, 
(2) f +g is contmuous at a. 


Moreover, if g(a) 4 0, then 


(3)  I/g is continuous at a. 


PROOF 


THEOREM 2 


PROOF 
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Since f and g are continuous at a, 

lim f(x) = f(a) and him g(x) = g(a). 
By Theorem 2(1) of Chapter 5 this mphes that 

lim Cf + eC) = {@) +2@) = (az 2a); 


which is just the assertion that f + g is continuous at a. The proofs of parts (2) 
and (3) are left to you. § 


Starting with the functions f(x) = c¢ and f(x) = x, which are continuous at a, 
for every a, we can use Theorem I to conclude that a function 


Dawe + 52a + Sea + bo 


is continuous at every point in its domain. But it is harder to get much further 
than that. When we discuss the sine function in detail it will be easy to prove that 
sin 1s continuous at a for all a; let us assume this fact meanwhile. A function lke 


5 Ph a 4: 
sin’ x¥ +x° +x" sin x 
>) Sea =. Oe 
sin” x +4x¢sin* x 


Leas 


can now be proved continuous at every point in its domain. But we are still 

unable to prove the continuity of a function like f(x) = sin(x*); we obviously 

need a theorem about the composition of continuous functions. Before stating this 

theorem, the following point about the definition of continuity is worth noting. If 

we translate the equation hin f(x) = f(a) according to the definition of limits, 
A lee 2 € 


we obtain 
for every € > 0 there is 6 > O such that, for all x, 

if 0 < |x —a| <6, then | f(x) — f(a)| < «. 

But in this case, where the hmit is f(a), the phrase 
0 < |x -—a| <6 
may be changed to the simpler condition 
|x —a| <6, 

since if x = a it is certainly true that | f(x) — f(@)| < e. 
If g is continuous at a, and f is continuous at g(a), then f og is continuous at a. 
(Notice that f is required to be continuous at g(a), not at a.) 
Let ¢ > 0. We wish to find a 6 > 0 such that for all x, 


if jw —a| < 6, then |(f og)(v) — (f o g)(a)| < &, 
Le, |f(g(x)) — f(g(a))| < «&. 
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We first use continuity of f to estimate how close g(x) must be to g(a) in order 
for this inequality to hold. Since f is continuous at g(a), there is a 6’ > O such 
that for all y, 


(1) if |y — g(a)| < 6’, then | f(y) — f(g(a))| < e. 
In particular, this means that 
(2) if |g(x) — g(a)| < 6’, then | f(g(x)) — f(g(a))| < e. 


We now use continuity of g to estimate how close x must be to a in order for the 
inequality |g(x) — g(a)| < 6’ to hold. The number 6’ is a positive number just like 
any other positive number; we can therefore take 6’ as the e (!) in the definition of 
continuity of g at a. We conclude that there is a 6 > O such that, for all x, 


(3) if |x —a| < 6, then |g(x) — g(a)| < 8. 
Combining (2) and (3) we see that for all x, 


if |x —a| <6, then | f(g(x)) — f(g(a))| < «. ff 


We can now reconsider the function 


xin leo we SO 


i= 0. a 


We have already noted that f is conunuous at 0. A few applications of Theorems | 
and 2, together with the continuity of sin, show that f 1s also continuous at a, for 
a £0. Functions like f(x) = sin(x? + sin(x + sin?(x3))) should be equally easy 
for you to analyze. 

The few theorems of this chapter have all been related to continuity of functions 
at a single point, but the concept of continuity doesn’t begin to be really interesting 
until we focus our attention on functions which are continuous at all poimts of some 
interval. If f is continuous at x for all x in (a,b), then f is called continuous 
on (a,b); as a “special case”, f is continuous on R = (—00, 0) [see page 57] if 
it is continuous at x for all x in R. Continuity on a closed interval must be defined 
a little differently; a function f is called continuous on [a, b] if 


(1) f is continuous at x for all x in (a, b), 


(2) hin JOS —@) andaini | a — 7). 


ct xX—>b- 
(We also often simply say that a function is continuous if it is continuous at x for 
all x in its domain.) 

Functions which are continuous on an interval are usually regarded as especially 
well behaved; indeed continuity might be specified as the first condition which a 
“reasonable” function ought to satisfy. A continuous function is sometines de- 
scribed, intuitively, as one whose graph can be drawn without lifting your pencil 
from the paper. Consideration of the function 


xsint/x, x #0 


a ie ee «30 


ae 


f(a) -€= 


TERE 5) 
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shows that this description ts a little too optimistic, but it is nevertheless ruc that 
there are many important results involving functions which are continuous on an 
interval. There theorems are generally much harder than the ones in this chapter, 
but there is a simple theorem which forms a bridge between the two kinds of results. 
The hypothesis of this theorem requires continuity at only a single pomt, but the 
conclusion describes the behavior of the function on some interval containing the 
poimt. Although this theorem is really a lemma for later arguments, it 1s included 
here as a preview of things to come. 


Suppose f is contmuous at a, and f(a) > 0. Then f(x) > 0 for all x in some 
interval containmg a; more precisely, there is a number 6 > O such that f(x) > 0 
for all x satisfying |v —a| < 6. Similarly, if f(a) < 0, then there is a number 6 > 0 
such that f(x) < 0 for all x satisfying |x —a| < 6. 


Consider the case f(a) > 0. Since f is continuous at a, for every ¢ > O there is a 
6 > O.such that, tor all x, 


if |x —a| <6, then | f(x) — f(a@| < «. 


Le., —e < f(x) — fla) <e. 


In particular, this must hold for ¢ = + f(a), since 5 f(a) > 0 (Fisure 3)? Tims 
there is 6 > O so that for all x, 


if |v —a| < 4, then —5 f(a) < f(x) — f(a) < 5 f(a), 


and this implies that f(x) > 1 f(a) > 0. (We could even have picked € to be f(a) 
itself, leading to a proof that is more elegant, but more confusing to picture.) 

A similar proof can be given in the case f(a) < 0; take ¢ = —5 fla). @iJoue 
can apply the first case to the function —/f. J 


PROBLEMS 


1. For which of the following functions f is there a continuous function F with 
domain R such that F(x) = f(x) for all x in the domain of f? 


foo 


Gi) f(x) = 0, x irrational. 
(iv) f(x) = 1/qg, x = p/q rational m lowest terms. 


2. At which pomts are the functions of Problems 4-17 and 4-19 continuous? 
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(a) Suppose that f is a function satisfying | f(x)| < |x| for all x. Show that 
f is continuous at 0. (Notice that f(0) must equal 0.) 

(b) Give an example of such a function f which is not continuous at any 
age. 

(c) Suppose that g is continuous at 0 and g(O) = 0, and |f(x)| < |g(x)|. 
Prove that f is continuous at 0. 


Give an example of a function f such that f is continuous nowhere, but | f| 
is continuous everywhere. 


For each number a, find a function which is continuous at a, but not at any 
other points. 


A a i ... but continuous 


hol 


(a) Finda function f which is discontinuous at 1, 
at all other points. 
(b) Find a function f which is discontinuous at 1, 5, i i, o2, alichat (but 


continuous at all other points. 


Suppose that f satisfies f(x + y) = f(x) + f(y), and that f is continuous 
at Q. Prove that f is continuous at a for all a. 


Suppose that f is continuous at a and f(a) = 0. Prove that if a 4 0, then 
f +a is nonzero in some open interval contaming a. 


(a) Suppose f is defined at a but is not continuous at a. Prove that for 
some number ¢ > 0 there are numbers x arbitrarily close to a with 
| f(x) — f(a)| > €. Mlustrate graphically. 

(b) Conclude that for some number e¢ > 0 either there are numbers x arbi- 
trarily close to a with f(x) < f(a) —e or there are numbers x arbitrarily 
close to a with f(x) > f(a) +e. 


(a) Prove that if f is continuous at a, then so ts | f|. 

(b) Prove that every function f continuous on R can be written f = E+ 0, 
where E is even and continuous and O 1s odd and continuous. 

(c). Prove that if f and g are continuous, then so are max(f, g) and 
min(f, g). 

(d) Prove that every continuous f can be written f = g —h, where g and h 
are nonnegative and continuous. 


Prove Theorem 1(3) by using Theorem 2 and continuity of the function 
f(x) =I /x. 


(a) Prove that if f is continuous at / and hm g(x) =/, then hin f(g(x)) = 


pe ds eae 2td | 
f(@). (You ean go right back to the definitions, but it is easier to consider 
the functioneG pvith G@)= 2G ior x ¥ a4 andaG (@) =1) 
(b) Show that if continuity of f at / is not assumed, then it is not generally 
jue thas Lan j(ai)) = fdim g()). Hint fry ff) =0 tor x 4d, and 
PC 


«>a 


Ff@O=l. 
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15. 


16. 
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(a) Prove that if f is continuous on [a,b], then there is a function g which 
is continuous on R, and which satisfies g(x) = f(x) for all x in [a, b]. 
Hint: Since you obviously have a great deal of choice, try making g 
constant on (—oo, a| and [b, oo). 

(b) Give an example to show that this assertion is false if [a, b] is replaced 


by (a,b). 


(a) Suppose that g and / are continuous at a, and that g(a) = h(a). Define 
f(x) to be g(x) if x > a and h(x) if x <a. Prove that f is continuous 
at a. 

(b) Suppose g is continuous on [a,b] and fh is continuous on [b,c] and 
g(b) = hitb) pelLetey Gaebere(s afor mem laeb|eand! k(x) foxx in [bpcy. 
Show that f is continuous on [a,c]. (Thus, continuous functions can be 
“pasted together”.) 


Prove that if f is continuous at a, then for any ¢ > 0 there is a 6 > O so that 


f(x) — fQ)| < «. 


(a) Prove the following version of ‘Vheorem 3 for “right-hand continuity”: 
Suppose that hm f(x) = f(a), and f(a) > 0. Then there is a number 
x—at 


whenever |x — a| < 6 and |y — a| < 6, we have 


6 > Osuch that f(x) > O for all x satisfying O < x —a < 6. Similarly, 
if f(a) < 0, then there is a number 6 > O such that f(x) < O for all x 
satisi ying Ol ee eo. 

(b) Prove a version of Theorem 3 when hm f(x) = f(b). 


x—>b- 
If lim f(x) exists, but is # f(a), then f is said to have a removable dis- 
Xue Ch 


continuity at a. 


(a) If f(x) = sin lf for x 4 and f(0) = 1, does f have: aenemovable 
discontinuity at 0? What if f(@~) = xsi 1/x for x 40, and f(0) = I? 

(b) Suppose f has a removable discontinuity at a. Let g(x) = f(x) for 
x sa, and let ¢(a@)*— lim f(x). Prove that g is continuous at a. (Don’t 


work very hard; this is quite easy.) 
(c) Let f(x) =0 if x is irrational, and let f(p/q) = 1/q if p/q is in lowest 
terms. What is the function g defined by g(x) = lim f(y)? 
aa 


*(d) Let f be a function with the property that every point of discontinuity 
is a removable discontinuity. “This means that lim f(y) exists for all x, 


youx 

but f may be discontinuous at some (even infinitely many) numbers x. 

Define g(x) = lim f(y). Prove that g is continuous. (This is not quite 
your 


so easy as part (b).) 


**e) Is there a function f which is discontinuous at every poimt, and which has 


only removable discontinuities? (It is worth thinking about this problem 
now, but mamily as a test of intuition; even if you suspect the correct 
answer, you will almost certainly be unable to prove it at the present 
time. See Problem 22-33.) 


CHAPTER THREE HARD THEOREMS 


‘This chapter 1s devoted to three theorems about continuous functions, and some 
of their consequences. ‘Vhe proofs of the three theorems themselves will not be 
given until the next chapter, for reasons which are explained at the end of this 
chapter. 


THEOREM 1_ If f is continuous on [a,b] and f(a) < 0 < f(b), then there is some x in [a,b] 
suchethraiey (x) = 0. 


(Geometrically, this means that the graph of a continuous function which starts 
below the horizontal axis and ends above it must cross this axis at some point, as 
in Figure 1.) 


THEOREM 2 If f is continuous on [a,b], then f is bounded above on [a, b], that is, there is 
some number WN such that f(x) < N for all x in [a, b]. 


(Geometrically, this theorem means that the graph of f lies below some line par- 
allel to the horizontal axis, as in Figure 2.) 


THEOREM 3 If f is continuous on [a,b], then there is some number y in [a,b] such that 
f) =F @ forall x in [a, b] (Figure’3). 


These three theorems differ markedly from the theorems of Chapter 6. ‘The 
hypotheses of those theorems always involved continuity at a single point, while 


i Rare 


FIG WAT el FIGURE 2 FIGURE 3 


FIGURE 4 


HG URS eS 


FIGURE 6 


THEOREM 4 
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the hypotheses of the present theorems require continuity on a whole interval 
(a, b| if continuity fails to hold at a single point, the conclusions may fail. For 
example, let f be the function shown in Figure 4, 


—1, N2e XD 


f@)= 
b, ee DS. 

Then f is continuous at every point of [0,2] except J2, and f(0) < 0 < f(2), 
but there is no point x in [0, 2] such that f(«) = 0; the discontinuity at the single 
point V2 is sufficient to destroy the conclusion of Theorem 1. 


Similarly, suppose that f is the function shown in Figure 5, 
y 8 


like Kea 0 


oie (7 ee 


Then f is continuous at every point of [0, 1] except 0, but f is not bounded above 
on [0, 1]. In fact, for any number N > O we have f(1/2N) =2N > N. 

This example also shows that the closed interval [a, 6] in Theorem 2 cannot be 
replaced by the open interval (a, 6), for the function f is continuous on (0, 1), but 
is not bounded there. 


Finally, consider the function shown in Figure 6, 
7) oS 


en x, eel 
a | Ope ol. 


On the interval [0,1] the function f is bounded above, so f does satisfy the 
conclusion of Theorem 2, even though f is not continuous on [0,1]. But f 
does not satisfy the conclusion of Theorem 3— there is no y in [0,1] such that 
f(y) = f(x) for all x in [0, 1]; im fact, it is certainly not true that f(1) = f(x) for 
all x in [0, 1] so we cannot choose y = 1, nor can we choose 0 < y < | because 
f(y).< fQ) it xas anymuniber with’ y. < x <_l. 

This example shows that Theorem 3 is considerably stronger than Theorem 2. 
Theorem 3 is often paraphrased by saying that a continuous function on a closed 
interval “takes on its maximum value” on that interval. 

As a compensation for the stringency of the hypotheses of our three theorems, 
the conclusions are of a totally different order than those of previous theorems. 
They describe the behavior of a function, not just near a point, but on a whole i- 
terval; such “global” properties of a function are always significantly more diflicult 
to prove than “local” properties, and are correspondingly of much greater power. 
To illustrate the usefulness of Theorems |, 2, and 3, we will soon deduce some im- 
portant consequences, but it will help to first mention some simple generalizations 
of these theorems. 


If f is continuous on [a,b] and f(a) < c < f(b), then there is some x im [a,b] 
suchethat fi(a_): =x 
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THEOREM 5 


PROOF 


THEOREM 6 


PROOF 


THEOREM 7 


PROOF 


THEOREM 8 


Let g= f —c. Then gis'continuous, and g(a) < 0 < g(b). By Theorem 1, there 
is some x in [a,b] such that g(x) = 0. But this means that f(x) = c. J 


If f is continuous on [a,b] and f(a) > ¢ > f(b), then there is some x in [a,b] 
such} that yf) = c. 


The function —f is continuous on [a,b] and — f(a) < -c < —f(b). By The- 
orem 4 there is some x in [a,b] such that —f(x) = —c, which means that 


fa=c.l 


Theorems 4 and 5 together show that f takes on any value between f(a) 
and f(b). We can do even better than this: if ¢ and d are in [a,b], then f 
takes on any value between f(c) and f(d). The proof is simple: if, for example, 
c < d, then just apply Theorems 4 and 5 to the interval [c,d]. Summarizing, if'a 
continuous function on an interval takes on two values, it takes on every value in 
between; this shght generalization of Theorem | is often called the Intermediate 

‘alue ‘Vheorem. 


If f is continuous on [a,b], then f is bounded below on [a,b], that is, there is 
some number N such that f(x) > N for all x in [a, b]. 


The function — f is contnuous on [a,b], so by Theorem 2 there is a number M 
such that — f(x) < M for all x in [a, b]. But this means that f(x) => —M for all x 
in [a,b], so we can let N = —M. J 


Theorems 2 and 6 together show that a continuous function f on [a,b] is 
bounded on [a, b], that is, there is a number N such that | f(«)| < N for all x in 
[a,b]. In fact, since Theorem 2 ensures the existence of a number Ny such that 
f(x) < N, for all x in [a,b], and Theorem 6 ensures the existence of a number 
Nz such that f(x) = No for all x in [a, b], we can take N = max({Nj|, |N2|). 


. 


If f is continuous on [a,b], then there is some y in [a,b] such that f(y) < f(x) 
for alk xm [ag)). 

(A continuous function on a closed interval takes on its minimum value on that 
interval.) 


The function — f is continuous on [a,b]; by Theorem 3 there is some y in [a, b| 
such that — f(y) = —f(x) for all x in [a,b], which means that f(y) < f(x) for 


all x in [a,b]. fj 


Now that we have derived the trivial consequences of Theorems 1, 2, and 3, we 
can begin proving a few miteresting things. 


very positive number has a square root. In other words, if a > O, then there is 


some number x such that +* =a. 


AG ORR Ba, 


PROOF 


THEOREM 9 


PROOF 
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Consider the function f(x) = x*, which is certainly continuous. Notice that the 
statement of the theorem can be expressed in terms of f: “the number @ has a 
square root” means that f takes on the value a. The proof of this fact about f 
will be an easy consequence of Theorem 4. 

There is obviously a number b > O such that f(b) > @ (as illustrated in Figure 7); 
in fact, if a > | we can take b = a, while if a < 1 we can take b = 1. Since 
f(O) <a < f(b), Theorem 4 applied to [0, b] implies that for some x (in [0, b}), 


. e 3 
we have f(x) =@, Le., x° =a. ff 


Precisely the same argument can be used to prove that a positive number has 
an nth root, for any natural number n. If n happens to be odd, one can do 
better: every number has an nth root. To prove this we just note that if the positive 
number @ has the nth root x, i.e., if x” =a, then (—x)” = —a (since n is odd), so 
—q has the nth root —x. The assertion, that for odd n any number @ has an ath 
root, is equivalent to the statement that the equation 


yn — 7 — 0 


has a root if n is odd. Expressed in this way the result is susceptible of great 
generalization. 


If n is odd, then any equation 
ated ee tee + ap = 0 


has a root. 


We obviously want to consider the function 
F(%) =x" + ay _px" | +++ +49; 


we would like to prove that f is sometimes positive and sometimes negative. ‘The 
intuitive idea is that for large |x|, the function is very much like g(x) = x” and, 
since 1 is odd, this function is positive for large positive x and negative for large 
negative x. A little algebra is all we need to make this intuitive idea work. 

The proper analysis of the function f depends on writing 


: pa an-| ao 
io ae eee ag — x" (1 $a pe SY, 
x x 
Note that 
an—| an-2 ag 
5 +f cod + m= 
Xx Ree ee 


p= | lag| 
|x| ee 


Consequently, if we choose x satisfying 


(*) 


. 


XR 2a lay tree cer lag 


then |x*| > |x| and 


| =k | lan—x| |dn—k| a es 
[xk] |x| Dina) 
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SO 
dy—] dy—2 di) | | I 
+ s3—=| SS =F 7 —— = 
x x? ee 2n 2n o 
n terms 
In other words, 
] @, a | 
ee | ie pea) ae 
DE hx ue 
which implies that 
l iss a 
ies ce | fe n ] ' « mO 
Z ba x" 


Therefore, if we choose an x; > 0 which satisfies (*), then 


ey (1 _— ) = NA 
2 Xx] (ia)! 


a 


so that f(x;) > 0. On the other hand, if x2 < 0 satisfies (*), then (x2)” < 0 and 


(5)? 


— a 
>to (1+4 eee ) = roe. 


2 Ce 


i) 


so that f(x) < 0. 
Now applying Theorem | to the interval [.x2..4;] we conclude that there is an x 
in [x2,x;] such that f(x) = 0. J 


Theorem 9 disposes of the problem of odd degree equations so happily that it 
would be frustrating to leave the problem of even degree equations completely 
undiscussed. At first sight, however, the problem seems insuperable. Some equa- 
tions, like x7 — 1 = 0, have a solution, and some, like x7 + 1 = 0, do not— what 
more is there to say? If we are willing to consider a more general question, how- 
ever, something interesting can be said. Instead of trying to solve the equation 


Puy en ee ee yr ea 


let us ask about the possibility of solving the equations 


| 


eT Gee Se see ig, 9c 


for all possible numbers c. ‘This amounts to allowing the constant term ao to vary. 
The information which can be given concerning the solution of these equations 
depends on a fact which is illustrated in Figure 8. 

The¢raph of thefunction (/@) =x"*-a,_(x" l4...4+ag, with 2 even, contains, 
at least the way we have drawn it, a lowest point. In other words, there is a 
number y such that f(y) < f(x) for all numbers x— the function f takes on a 
minimum value, not just on each closed interval, but on the whole line. (Notice 
that this is false if # is odd.) ‘The proof depends on ‘Theorem 7, but a tricky 
application will be required. We can apply ‘Theorem 7 to any interval [a,b], and 
obtain a pout yo such that f(yo) is the minimum value of f on [a,b]; but if [a,b] 
happens to be the interval shown in Figure 8, for example, then the point yo will 
not be the place where f has its nunimum value for the whole line. In the next 
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theorem the entire point of the proof is to choose an interval [a,b] in such a way 
that this cannot happen. 


THEOREM 10 If n is even and f(x) =x" +a,_,x""! +--+ + ao, then there is a number y such 
that. £6). = Aca) itoriall x. 


PROOF As in the proof of Theorem 9, if 


Me tnae(! 92021 GP— Wrudtote Ze |OU Ns 
then for all x with |x| > M, we have 
l an—| ao 
~ < 14+ —4+---4+ — 
2 x = 
Since. is even, x= O for alll x, so 
vo apy ao 
« Aa— 
— <x"(1+ Sty. + 2) = fon, 
Ds £3 bl 


provided that |x| > M. Now consider the number f(Q). Let b > 0 be a number 
such that b” > 2 f(0) and also b > M. Then, if x => b, we have (Figure 9) 


se ra Be . 0 
hg) == = FC ) 
zi Similarly, if x < —b, then 
see =/p H bh” 
FIGURE 9 oe > Gras > sO, 


Summarizing: 


i = Dory = —p, then f(x) = f (0). 


Now apply Theorem 7 to the function f on the interval [—b, b]. We conclude 
that there is a number y such that 


(1) Meee r= 'D, then f(y) = 7): 
In particular, f(y) < f(0). Thus 
(2) ieee) or x =), then f(x) =O) = FQ). 


Combining (1) and (2) we see that f(y) < f(x) for all x. J 


Theorem 10 now allows us to prove the following result. 


THEOREM 11 — Consider the equation 


i 


(+) x" + ay yx" + ag =. 
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and suppose 1 1s even. ‘Then there is a number m such that (*) has a solution for 
c > m and has no solution for ¢ < m. 


cia = ee eee, (Figure 10). 

According to Theorem |0 there is a number y such that f(y) < f(x) for all x. 
Let m = f(y). If ¢ < m, then the equation (+) obviously has no solution, since 
the left side always has a value > m. If c = m, then (*) has y as a solution. 
Finally, suppose c > m. Let b be a number such that b > y and f(b) > c. Then 
f(y) =m <c < f(b). Consequently, by Theorem 4, there is some number x in 
[y, b] such that f(x) =c, so x is a solution of (*). J 


These consequences of Theorems 1, 2, and 3 are the only ones we will derive 
now (these theorems will play a fundamental role in everything we do later, how- 
ever). Only one task remains—to prove Theorems |, 2, and 3. Unfortunately, 
we cannot hope to do this—-on the basis of our present knowledge about the real 
numbers (namely, PI—-P12) a proof is impossible. ‘There are several ways of con- 
vineing ourselves that this gloomy conclusion is actually the case. For example, 
the proof of Theorem 8 relies only on the proof of Theorem 1; if we could prove 
Theorem 1, then the proof of Theorem 8 would be complete, and we would have 
a proof that every positive number has a square root. As pomted out in Part I, it 
is impossible to prove this on the basis of PI ~P12. Again, suppose we consider the 
function 


I 
fx) = 5 op) 
If there were no number x with x* = 2, then f would be continuous, since the 
denominator would never = 0. But f is not bounded on [0,2]. So Theorem 2 
depends essentially on the existence of numbers other than rational numbers, and 
therefore on some property of the real numbers other than P1—P12. 

Despite our inability to prove Theorems |, 2, and 3, they are certainly results 
which we want to be true. If the pictures we have been drawing have any con- 
nection with the mathematics we are doing, if our notion of continuous function 
corresponds to any degree with our intuitive notion, Theorems |, 2, and 3 have 
got to be true. Since a proof of any of these theorems must require some new 
property of R which has so far been overlooked, our present difficulties suggest a 
way to discover that property: let us try to construct a proof of ‘Theorem 1, for 
example, and see what goes wrong, 

One idea which seems promising is to locate the first point where f(x) = 0, that 
is, the smallest x in [a,b] such that f(x) = 0. ‘To find this point, first consider 
the set A which contams all numbers x in [a,b] such that f is negative on [a,x]. 
In Figure 11, x is such a poit, while x’ is not. ‘The set A itself is indicated by a 
heavy line, Since f is negative at a, and positive at b, the set A contams some 
points greater than a, while all points sufliciently close to b are not in A. (We are 
here using the continuity of f on [a,b], as well as Problem 6-16.) 
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f(x) < 0 for all x in this interval : ; a2 
Now suppose @ is the smallest number which is greater than all members of A; 


clearly a < a < b. We claim that f(a) = 0, and to prove this we only have to 

eliminate the possibilities f(a) <0 and f(a) > 0. 
Suppose first that f(@) <0. Then, by Theorem 6-3, f(x) would be less than 0 
a b for all x ma small interval containing a, in particular for some numbers bigger 
than @ (Figure 12); but this contradicts the fact that a is bigger than every member 


eee TS alse aoatata of A, since the larger numbers would also be in A. Consequently, f(a) < 0 is 
all these points false. 

ie a On the other hand, suppose f(@) > 0. Again applying Theorem 6-3, we see that 
f(x) would be positive for all x in a small interval containing q@, in particular for 
some numbers smaller than @ (Figure 13). ‘This means that these smaller numbers 
are all not in A. Consequently, one could have chosen an even smaller @ which 
would be greater than all members of A. Once again we have a contradiction; 
f(a) > Os also false. Hence f(a) = 0 and, we are tempted to say, Q.E.D. 

We know, however, that something must be wrong, since no new properties of R 
were ever used, and it does not require much scrutiny to find the dubious point. 
It is clear that we can choose a number @ which is greater than all members of A 
(for example, we can choose a = b), but it is not so clear that we can choose a 
smallest one. In fact, suppose A consists of all numbers x > 0 such that x? < 2. 


A could really be 
only this “| 


If the number V2 did not exist, there would not be a least number greater than 


a i b all the members of A; for any y > V2 we chose, we could always choose a still 
f(x) > 0 for all x smaller one. 
ete Now that we have discovered the fallacy, it is almost obvious what additional 
property of the real numbers we need. All we must do is say it properly and use it. 


FIGURE 13 That is the business of the next chapter. 


PROBLEMS 


1. For each of the following functions, decide which are bounded above or below 
on the indicated interval, and which take on their maximum or minimum 
value. (Notice that f might have these properties even if f is not continuous, 
and even if the interval is not a closed interval.) 


Qe POOR x” omt— le 1). 
Af == x On eS ay. 
tie ey om 

(iv) f(x) =x? on [0, 00). 


3) 
. aya LESS - 
(Vie ei = on (—a.— l,a +1). (We assume a > —'1, so 
a+2, x>a 
that —~a— 1 <a +1; it will be necessary to consider several possibilities 
for a.) 
ee eee 
. 5 » San at (Cl . 
(vi) eyker on [—a— l.a +1]. (Again assume a > —1.) 
a+2, x>a = 


EOS | 0. X irrational once 


Worx = p/q in lowest terms 


130 = foundations 


= li, x irrational 
Ce ae | l/q, x = p/q in lowest terms oe 
Hy x irrational 
Ss | —lh/q, x = p/q m lowest terms oo ee 
x, X rational 
ae | 0, x irrational °" Mabe 


ey sin7(cosx + Va +a?) on (0. a°}. 
Gat) f(x) = [x]sons(0; a]. 


For each of the following polynomial functions /, find an mteger n such that 
f(x) =0 for some x between n and n+ 1. 

i) f@)=x? —x43. 

file? OO) = 17 eoag 2, 
Cie On) = Mb ad 

Gv ef(s) =94x* Si4x + I 


Prove that there is some number x such that 


. 163 
(1) x19 4 —______= 119. 
l+x-¢+sin* x 


Gilessindy = 2% —el: 
This problem is a continuation of Problem 3-7. 


(a) If n —k is even, and > 0, find a polynomial function of degree n with 
exactly & roots. 

(b) A root a of the polynomial function f ts said to have multiplicity m 
if f(x) = (x — a)" g(x), where g is a polynomial function that does not 
have a as a root. Let f be a polynomial function of degree n. Suppose 
that f has k roots, counting multiplicities, 1.e., suppose that k is the sum 
of the multiplicities of all the roots. Show that n — & ts even. 


Suppose that f is continuous on [a,b] and that f(x) is always rational. What 
can be said about f? 


Suppose that f is a continuous function on [—1. 1] such that x7 +(f(x))? = 1 
for all x. (This means that (x, f(¥)) always lies on the unit circle.) Show that 


either f(x) = V1 — x? for all x, or else f(x) = —V 1 — x? for all x. 


. . p . Carey a rs 
How many continuous functions f are there which satisfy (f(4))° = x° for 
all’? 


Suppose that f and g are continuous, that f? = 97, and that f(x) 4 0 for 
all x. Prove that cither f@) = g(x) for all x, or else fx) = —g2(x) for all x. 


(a) Suppose that f is continuous, that f(x) = 0 only for x = a, and that 
f(x) > 0 for some x > a as well as for some x < a. What can be said 
about f(x) for all « 4A.a? 


FIGURE 14 


(1, 1) 


10. 


11. 


1 ap 


13. 


14. 


*15, 


*16. 


* le. 
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(b) Again assume that f is continuous and that f(x) = 0 only for x = a, 
but suppose, instead, that f(x) > 0 for some x > a and f(x) < 0 for 
some x < a. Now what can be said about f(x) for x 4a? 


—~e . 7 3 3} 
*(c) Discuss the sign of x3 + x?y + xy? + y? when x and y are not both 0. 


Suppose f and g are continuous on [a, b] and that f(a) < g(a), but f(b) > 
g(b). Prove that f(x) = g(x) for some x in [a,b]. (If your proof isn’t very 
short, it’s not the right one.) 


Suppose that f is a continuous function on [0, 1] and that f(x) is in [0, 1] 
for each x (draw a picture). Prove that f(*) = x for some number x. 


(a) Problem 11 shows that f intersects the diagonal of the square in Fig- 
ure 14 (solid ne). Show that f/ must also intersect the other (dashed) 
diagonal. 

(b) Prove the following more general fact: If g is continuous on [0, 1] and 
@(0) 0, el) = Cor 20) =), (1) = 0, them | Ge) = ce) formsanner: 


(a) Let fj (2) = Simply: for x 4 0 and let _f(0) = 0. Is f contmmouston 
[—1. 1]? Show that f satisfies the conclusion of the Intermediate Value 
Theorem on [—1, 1]; m other words, if f takes on two values somewhere 
on {[—1, I], it also takes on every value in between. 


*(b) Suppose that f satisfies the conclusion of the Intermediate Value Theo- 


rem, and that f takes on each value only once. Prove that f is continuous. 


*(c) Generalize to the case where f takes on each value only finitely many 


times. 


If f is a continuous function on [0, 1], let || f|| be the maximum value of | f| 


Ory (ee |i 


(a) Prove that for any number c we have ||cf || = [el - fl. 


*(b) Prove that || f + gll < Il fll + Ilgll. Give an example where || f + g|| 4 


fil + llgll. 
(c) Prove.that || — f|| < ||4 —gl|+ 


So lle 
Suppose that ¢@ is continuous and lim ¢(x)/x" =O= lim (x)/x". 
A ia HOS X——00 
(a) Prove that if 2 1s odd, then there is a number x such that +" + (x) = 0. 


(b) Prove that if n is even, then there is a number y such that vy" + ¢(y) < 
x(x) tovtall x. 


Hint: Of which proofs does this problem test your understanding? 


(a) Suppose that f 1s continuous on (a,b) and lim f(.) = lm f(x) = oo. 
x—at x : 


Prove that f has a mmimium on all of (a,b). 


X—>b- 
(b) Prove the corresponding result when a = —oo and/or b = oo. 


Let f be any polynomial function. Prove that there is some number y such 


that-(f(y))-< Ge) |sfor-all x. 
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*18. Suppose that f is a continuous function with f(x) > O for all x, and 


lim f(x) =0O= hm f(x). (Draw a picture.) Prove that there is some 
) re O a> — OS 


number y such that f(y) > f(x) for all x. 


#19. (a) 


(b) 
(c) 
(d) 
FIGURE 15 
(e) 
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(b) 


(d) 


Suppose that f is continuous on [a, b], and let x be any number. Prove 
that there is a point on the graph of f which is closest to (v,0); in 
other words there is some y in [a, b] such that the distance from (x, 0) 
to (y, f(y)) is = distance from (x, 0) to (z, f(z)) for all z m [a, b]. See 
Figure 15.) 

Show that this same assertion is not necessarily true if [a, b] is replaced 
by (a, b) throughout. 

Show that the assertion zs true if [a, b] is replaced by R throughout. 

In cases (a) and (c), let g(x) be the minimum distance from (x, 0) to a 
point on the graph of f. Prove that g(y) < g(x) + |x — y|, and conclude 
that g is continuous. 

Prove that there are numbers x9 and x; m1 [a,b] such that the distance 
(ronn (ug) to (1, f (x1)) se the distance fromm (mp , 0) to Ga. 7 Oa 
for any xo’, x1’ m [a, bd]. 


Suppose that f is continuous on [0,1] and f(0) = f(1). Let 2 be any 
natural number. Prove that there 1s some number x such that f(x) = 
f(x+1/n), as shown in Figure 16 for n = 4. Hint: Consider the function 
g(x) = f(x) — f(x + 1/n); what would be true if g(x) 4 0 for all x? 
Suppose 0 < a < 1, but that a is not equal to 1/n for any natural 
number n. Find a function f which is continuous on [0, 1] and which 
satishes f(O0) = f(1), but which does not satisfy f(x) = f(x + a) for 
any X. 


Prove that there does not exist a continuous function f defined on R 
which takes on every value exactly twice. Hint: If f(a) = f(b) for 
a < bMiienseither.. f Or> Yf(G@itor all x in & DY er f(x) = Ga iior 
all x in (a,b). Why? In the first case all values close to f(a), but shghtly 
larger than f(a), are taken on somewhere in (a,b); this imphes that 
i (ere i@) ior x < a ances p. 

Refine part (a) by proving that there is no contmuous function f which 
takes on each value either 0 times or 2 times, 1.e., which takes on exactly 
twice each value that it does take on. Hint: ‘The previous hint implies 
that f has either a maximum or a mimimum value (which must be taken 
on twice). What can be said about values close to the maximum value? 
Find a continuous function f which takes on every value exactly 3 times. 
More generally, find one which takes on every value exactly ” times, if 
nis odd. 

Prove that if nm is even, then there is no continuous f which takes on 
every value exactly n times. Hint: ‘To treat the case n = 4, for example, 
let fi) = fC) = fs) = fa). Phet eithtm f(s) > Onfor all tem 
two of the thréwintervals (¢1).42), (x2..¥3), (3, xa), or tle f@) < Ofor 
all x in two of these three intervals. 


CHAPTER 


DEFINITION 


DEFINITION 


LEAST UPPER BOUNDS 


‘his chapter reveals the most important property of the real numbers. Never- 
theless, it is merely a sequel to Chapter 7; the path which must be followed has 
already been indicated, and further discussion would be useless delay. 


A set A of real numbers is bounded above if there is a number x such that 


x >a_ for every a in A. 


Such a number x is called an upper bound for A. 


Obviously A is bounded above if and only if there is a number x which is an 
upper bound for A (and in this case there will be lots of upper bounds for A); we 
often say, as a concession to idiomatic English, that “A has an upper bound” when 
we mean that there is a number which is an upper bound for A. 

Notice that the term “bounded above” has now been used in two ways- first, in 
Chapter 7, in reference to functions, and now in reference to sets. ‘Uhis dual usage 
should cause no confusion, since it will always be clear whether we are talking 
about a set of numbers or a function. Moreover, the two definitions are closely 
connected: if A is the set {f(x) : a < x < b}, then the function f is bounded 
above on [a, b] if and only if the set A is bounded above. 

The entire collection R of real numbers, and the natural numbers N, are both 
examples of sets which are not bounded above. An example of a set which zs 
bounded above is 


Ary a x = |. 


To show that A is bounded above we need only name some upper bound for A, 
which is easy enough; for example, 138 is an upper bound for A, and so are 2, 
le, 14. and 1. Clearly, | is the least upper bound of A; although the phrase 


just introduced is self-explanatory, in order to avoid any possible confusion (in 


particular, to ensure that we all know what the superlative of “less” means), we 
define this explicitly. 


A number x is a least upper bound of A if 


(1) x is an upper bound of A, 


and (2) if y isan upper bound of A, then x < y. 
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The use of the indefinite article “a” im this definition was merely a concession 
to temporary ignorance. Now that we have made a precise definition, it is easily 
seen that if x and y are both least upper bounds of A, then x = y. Indeed, in this 


case 
x <y, since y is an upper bound, and x is a least upper bound, 
and y <x, since x 1s an upper bound, and y is a least upper bound; 
it follows that x = y. For this reason we speak of the least upper bound of A. 


‘The term supremum of A is synonymous and has one advantage. It abbreviates 
quite nicely to 
sup A (pronounced “soup A”) 


and saves us from the abbreviation 
lub A 


(which is nevertheless used by some authors). 

There is a series of important definitions, analogous to those just given, which 
can now be treated more briefly. A set A of real numbers is bounded below if 
there is a number x such that 


bs 2) for every a in A. 


Such a number x is called a lower bound for A. A number x is the greatest 
lower bound of A if 


(1) x isa lower bound of A, 
and (2) if y isa lower bound of A, then x > y. 


The greatest lower bound of A 1s also called the infimum of A, abbreviated 
inf A: 
some authors use the abbreviation 


elb A. 


One detail has been omitted from our discussion so far— the question of which 
sets have at least one, and hence exactly one, least upper bound or greatest lower 
bound. We will consider only least upper bounds, since the question for greatest 
lower bounds can then be answered easily (Problem 2). 

If A is not bounded above, then A has no upper bound at all, so A certainly 
cannot be expected to have a least upper bound. It is tempting to say that A does 
have a least upper bound if it has some upper bound, but, like the principle of 
mathematical induction, this assertion can fail to be true in a rather special way. 
If A = %, then A is bounded above. Indeed, any number x is an upper bound 
for ~: 


x > y for every y ind 


sunply because there is no y in J. Since every number is an upper bound for ¥, 
there is surely no least upper bound for @. With this trivial exception however, 
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fx) <0 for alll x 
in this interval 
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f(x) > 0 for all x 


in this interval 


I EC LOM 18) 


8. Least Upper Bounds 135 


our assertion is true~~-and very important, definitely important enough to warrant 
consideration of details. We are finally ready to state the last property of the real 
numbers which we need. 


(P13) (The least upper bound property) If A is a set of real numbers, 
A #¥%, and A is bounded above, then A has a least upper bound. 


Property P13 may strike you as anticlimactic, but that is actually one of its 
virtues. ‘To complete our list of basic properties for the real numbers we require no 
particularly abstruse proposition, but only a property so simple that we might feel 
foolish for having overlooked it. Of course, the least upper bound propcrty is not 
really so mnocent as all that; after all, it does not hold for the rational numbers Q. 
For example, if A is the set of all rational numbers x satisfying x* < 2, then there 
is no rational number y which is an upper bound for A and which is less than or 
equal to every other rational number which is an upper bound for A. It will become 
clear only gradually how significant P13 is, but we are already in a position to 
demonstrate its power, by supplying the proofs which were omitted in Chapter 7. 


If f is continuous on [a,b] and f(a) < 0 < f(b), then there is some number x 
in i@, biisuchythat f@) =O. 


Our proof is merely a rigorous version of the outline developed at the end of 
Chapter 7—we will locate the smallest number x in [a,b] with f(x) = 0. 
Define the set A, shown in Figure 1, as follows: 


A ={x:a<x <b, and f is negative on the interval [a, x]}. 


Clearly A 4 ¥, since a ts in A; in fact, there ts some 6 > O such that A contains 
all points x satisfying a < x < a+; this follows from Problem 6-16, since f is 
continuous on [a,b] and f(a) < 0. Similarly, 6 is an upper bound for A and, m 
fact, there is a 6 > O such that all points + satisfying b — 6 < x < b are upper 
bounds for A; this also follows from Problem 6-16, since f(b) > 0. 

From these remarks it follows that A has a least upper bound @ and that 
a <a <b. We now wish to show that f(a) = 0, by eliminating the possibil- 
ities f(a) < O and f(a) > 0. 

Suppose first that f(@~) < 0. By Theorem 6-3, there is a 5 > 0 such that 
f@) < 0 fora —6 <x <a-+6 (Figure 2). Now there is some number xo in A 
which satisfies a — 6 < x9 < @ (because otherwise a would not be the least upper 
bound of A). ‘This means that f is negative on the whole interval [a, xo]. But if 
x, 1s anumber between a@ and w +4, then f is also negative on the whole interval 
[xo,.x1]. Vherefore f ts negative on the interval [a,x,], so x; is m A. But this 
contradicts the fact that a is an upper bound for A; our original assumption that 
f(a) <0 must be false. 

Suppose, on the other hand, that f(@) > 0. Then there ts a number 6 > 0 such 
that f(x) > 0 fora—65 <x <a+6 (Figure 3). Once again we know that there is 
an xg in A satisfying a — 6 < xg < a; but this means that f is negative on [a, xo], 
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which is impossible, since f(x9) > 0. Thus the assumption f(a) > 0 also leads to 
a contradiction, leaving f(@) = 0 as the only possible alternative. J 


The proofs of ‘Theorems 2 and 3 of Chapter 7 require a simple preliminary 
result, which will play much the same role as ‘Theorem 6-3 played in the previous 
proof. 


If f is continuous at a, then there is a number 6 > 0 such that f is bounded 
above on the interval (a — 5,a + 5) (see Figure 4). 


Since linvefitc) = f(a)mtherens,slormevery ¢ > 0,a 6 > 0 suchwthat, for all x, 
a A 


if |x —a| <6, then | f(x) — f(a)| < «. 


It is only necessary to apply this statement to some particular ¢ (any one will do), 
for example, ¢ = 1. We conclude that there is a 6 > 0 such that, for all x, 


if |v —a| < 6, then | f(x) — f(a)| < 1. 


It follows, in particular, that if |x — a| < 6, then f(x) — f(a) < 1. ‘This completes 
the proof: on the interval (a — 6,a + 5) the function f is bounded above by 


flay+1. 


It should hardly be necessary to add that we can now also prove that f is 
bounded below on some interval (a — 5,a +4), and, finally, that f is bounded on 
some open interval containing a. 

A more significant pomt is the observation that if, lim, f(«) = f(a), then there 
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is a 6 > O such that f is bounded on the set {x : a < x < a+}, and a similar 


observation holds if lm f(x) = f(b). Having made these observations (and 
1 bs ‘ 


assuming that you will supply the proofs), we tackle our second major theorem. 
If f is continuous on [a,b], then f is bounded above on [a, 5]. 


Let 
= {xia <x < band f is bounded above on [a,x]}. 


Clearly A 4 ¥ (since a is in A), and A is bounded above (by b), so A has a least 
upper bound a. Notice that we are here applying the term “bounded above” both 
to the set A, which can be visualized as lying on the horizontal axis, and to f, ie., 
to the sets {f(y) : a < y <x}, which can be visualized as lying on the vertical axis 
(Figure 5). 

Our first step is to prove that we actually have a = b. Suppose, instead, that 
a <b. By Theorem | there is 5 > Osuch that f is bounded on (a—5,a+65). Since 
a is the least upper bound of A there is some xg in A satisfying a—5 < x9 <a. This 
means that f is bounded on [a, xo]. Butif xy 1s any number with a < x7 <a+6, 
then f is also bounded on [x9, x1]. Therefore f is bounded on [a,x;], so x, ts 
in A, contradicting the fact that @ is an upper bound for A. This contradiction 
shows that a = b. One detail should be mentioned: this demonstration implicitly 
assumed that a <a [so that f would be defined on some interval (@ — 5,a + 5)]; 
the possibility a = @ can be ruled out similarly, using the existence of a 6 > O such 
that f is bounded on {x :a <x <a+6}. 

The proofis not quite complete—we only know that f is bounded on [a..x]| for 
every x < b, not necessarily that f is bounded on [a,b]. However, only one small 
argument needs to be added. 

There is a 6 > O such that f ts bounded on {x : b—-—6 < x < b}. There ts xo 
in A such that b~— 6 < x9 < b. Thus f is bounded on [a@, xo| and also on [.xo, 5], 
so f is bounded on [a,b]. Jj 


To prove the third important theorem we resort to a trick. 


If f is continuous on [a,b], then there is a number y in [a,b] such that f(y) = 


f (x) for all x in [a, 5]. 


We already know that f is bounded on [a,b], which means that the set 
{f@) -x In la, b|} 


is bounded. This set is obviously not 4, so it has a least upper bound @. Since 
a > f(x) for x in [a,b] it suffices to show that @ = f(y) for some y in [a,b]. 

Suppose instead that a 4 f(y) for all y im [a,b]. Then the function ¢ defined 
by 


2) == xin [a,b] 


a — T(t) 
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is continuous on [a,b], since the denominator of the right side is never 0. On the 
other hand, @ is the least upper bound of { f(x) : x in [a, >] }; this means that 


for every ¢ > O there sex in, (wD) wah = of (x) <_&. 
This, in turn, means that 
for every ¢ > 0 there is x in [a, b] with g(x) > I/e. 


But this means that g is not bounded on |a, b], contradicting the previous theo- 
rem. ff 


At the beginning of this chapter the set of natural numbers N was given as an 
example of an unbounded set. We are now going to prove that N is unbounded. 
After the difficult theorems proved in this chapter you may be startled to find 
such an “obvious” theorem winding up our proceedings. Ifso, you are, perhaps, 
allowing the geometrical picture of R to influence you too strongly. “Look,” you 
may say, “the real numbers look hke 


ane pean eae eat et 

0 l 2 S) (EOS aii ell 
so every number x is between two integers n,n + | (unless x is itself an integer.” 
Basing the argument on a geometric picture is not a proof, however, and even the 
geometric picture contains an assumption: that if you place unit segments end-to- 
end you will eventually get a segment larger than any given segment. This axiom, 
often omitted from a first introduction to geometry, is usually attributed (not quite 


justly) to Archimedes, and the corresponding property for numbers, that N is not 


bounded, is called the Archimedean property of the real numbers. ‘This property 1s nod 
a consequence of PI P12 (see reference [14] of the Suggested Reading), although 
it does hold for Q., of course. Once we have P13 however, there are no longer 
any problems. 


N is not bounded above. 


Suppose N were bounded above. Since N ¥ ¥, there would be a least upper 
bound @ for N. ‘Then 


aaa for all n nN. 


Consequently, 


a>n+1 forallninN, 
since n+ Lis in N if nis im N. But this means that 
@—-id>m forall min N, 


and this means that a — | is also an upper bound for N, coutvadicting the fact that 
a is the least upper bound. 


THEOREM 3 


PROOF 
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There is a consequence of Theorem 2 (actually an equivalent formulation) which 
we have very often assumed implicitly. 


For any €¢ > O there is a natural number 7 with I/n < €. 


Suppose not; then 1/n > e€ for all nin N. Thus < 1/e for all n in N. But this 
means that }/¢ is an upper bound for N, contradicting Theorem 2. § 


A brief glance through Chapter 6 will show you that the result of Theorem 3 
was used in the discussion of many examples. Of course, Theorem 3 was not 
available at the time, but the examples were so important that in order to give 
them some cheating was tolerated. As partial justification for this dishonesty we 
can claim that this result was never used in the proof of a theorem, but if your faith 
has been shaken, a review of all the proofs given so far is in order. Fortunately, 
such deception will not be necessary again. We have now stated every property of 
the real numbers that we will ever need. Henceforth, no more hes. 


PROBLEMS 


1. Find the least upper bound and the greatest lower bound (if they exist) of 
the following sets. Also decide which sets have greatest and least elements 
(i.e., decide when the least upper bound and greatest lower bound happens 
to belong to the set). 


(1) {os in NY 


l 
(ii) | fin Zand wn 4 of. 


(it) (x: = Osone— dl / for some 4 in Ni}. 
(iw) {te Oe= 2 = J/2 and x is rational}. 

607) aad WE: ee ty le) 

(vi) {vix? +x —1 <0}. 

(vii) (ee = Omid xa — 1 = Oy 


(vill) - a — i) ce 10 Nn}. 
2. (a) Suppose A # M is bounced below. Let —A denote the set of all —x 
for x in A. Prove that —A 4 ¥, that —A is bounded above, and that 
— sup(—A) 1s the greatest lower bound of A. 
(b) If A 4 % 1s bounded below, let B be the set of all lower bounds of A. 
Show that B 4 ¥, that B is bounded above, and that sup B 1s the greatest 
lower bound of A. 


3. Let f be a contmuous function on [a,b] with f(a) <0 < f(b). 
(a) ‘The proof of ‘Theorein 7-]} showed that there is a smallest x m [a,b] 
with f(x) = 0. «If there 1s more than one-x in [a,b] with f(x) = 0, 
is there necessarily a second smallest? Show that there is a largest x mn 
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[a,b] with f(x) = 0. (Try to give an easy proof by considering a new 
function closely related to f.) 

(b) ‘The proof of Theorem 7-1 depended upon considering A = {x :a < 
x < band f is negative on [a, x]}. Give another proof of Theorem 7-1, 
which depends upon consideration of B = {x (a =x = Dancer 
OQ}. Which point x in [a,b] with f(+) = 0 will this proof locate? Give 
an example where the sets A and B are not the same. 


(a) Suppose that f is continuous on [a,b] and that f(a) = f(b) = 0. 
Suppose also that f(x%9) > O for some xo in [a,b]. Prove that there are 
munoersc and d withe =c <x <d = b suclmthat f(c) = f(e)i—O, 
but f(x) > 0 for all x m (c,d). Hint: The previous problem can be used 
to good advantage. 

(b) Suppose that f is conunuous on [a,b] and that f(a) < f(b). Prove that 
theyecare numbers.c and d with a@ <c < d = b sughsthat f(c)e= Ala) 


AlGuesleds) = f (Dy and! fla) = f(x) = fd) Jor all xeMale.d). 


(a) Suppose that y— x > 1. Prove that there is an integer k such that 
x <k < y. Hmt: Let / be the largest integer satisfying / < x, and 
consider / + I. 

(b) Suppose x < y. Prove that there is a rational number r such that x < 
r< y. Hint: if 1/n < y—x, then my —nx > |. (Query: Why have parts 
(a) and (b) been postponed until this problem set?) 

(c) Suppose that r < s are rational numbers. Prove that there is an irrational 
number between r and s. Hint: As a start, you know that there is an 
irrational number between 0 and 1. 

(d) Suppose that « < y. Prove that there is an irrauonal number between x 
and y. Hint: It is unnecessary to do any more work; this follows from 


(b) and (c). 


A set A of real numbers is said to be dense if every open interval contains a 
point of A. For example, Problem 5 shows that the set of rational numbers 
and the set of irrational numbers are each dense. 


(a) Prove that if f is contnuous and f(x) = 0 for all numbers x in a dense 
SeteA them ¢ («) = Ofor allex® 

(b) Prove that if f and g are contmuous and f(x) = g(x) for all x ma dense 
Set"A, teu) (x)= ee) forall x 

(c) Ifwe assume instead that f(x) > g(x) for all x m A, show that f(x) = 
g(x) for all x. Gan > be replaced by > throughout? 


Prove that if f is continuous and f(x + vy) = f(x) + f(Q’) for all x and y, 
then there is a number c such that f(x) = cx for all x. (This conclusion 
can be demonstrated snnply by combining the results of two previous prob- 
lems.) Pomt of information: ‘There do exist noncontinuous functions f satisfying 
f(x ty) = f(x) + f(y) for all x and y, but we cannot prove this now; in 
fact, this simple question involves ideas that are usually never mentioned im 
undergraduate courses (see reference [7] in the Suggested Reading). 
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Suppose that f is a function such that f(a) < f(b) whenever a < b (Fig- 
ure 6). 


(a) Prove that lim f(x) and lim f(x) both exist. Hint: Why is this prob- 


+. le Bf € 
lem m this chapter? 


(b) Prove that f never has a removable discontinuity (this termimology comes 
from Problem 6-17). 

(c) Prove that if f satisfies the conclusions of the Intermediate Value ‘Vhe- 
orem, then f is continuous. 


If f is a bounded function on [0, 1], let || fll] = sup{ 7 Cl ime | 0: |}. 
Prove analogues of the properties of || |] in Problem 7-14. 


Suppose a > 0. Prove that every number x can be written uniquely in the 
form x = ka + x’, where k is an integer, and 0 <x’ <a. 


(a) Suppose that ay, a2,a3,... 18 a sequence of positive numbers with 
Qn+1 < 4/2. Prove that for any ¢ > 0 there is some n with a, < é. 

(b) Suppose P is a regular polygon inscribed inside a circle. If P’ is the 

inscribed regular polygon with twice as many sides, show that the differ- 

ence between the area of the circle and the area of P’ is less than half the 

difference between the area of the circle and the area of P (use Figure 7). 

Prove that there 1s a regular polygon P mscribed in a circle with area 


— 
~ 
ae 


as close as desired to the area of the circle. In order to do part (c) you 
will need part (a). This was clear to the Greeks, who used part (a) as the 
basis for their entire treatment of proportion and area. By calculating 
the areas of polygons, this method (“the method of exhaustion”) allows 
computations of z to any desired accuracy; Archimedes used it to show 
29) 


Nae : : : 
that 4> < 7 < =. Butit has far greater theoretical importance: 


(d) Using the fact that the areas of two regular polygons with the same num- 
ber of sides have the same ratio as the square of their sides, prove that the 
areas of two circles have the same ratios as the square of their radii. Hint: 
Deduce a contradiction from the assumption that the ratio of the areas 
is greater, or less, than the ratio of the square of the radu by inscribing 
appropriate polygons. 


Suppose that A and B are two nonempty sets of numbers such that . < y 
for all x in A and all y in B. 


(a) Prove that sup A < y for all y in B. 
(b) Prove that sup A < inf B. 


Let A and B be two nonempty sets of numbers which are bounded above, and 
let A+B denote the set of all numbers ++ y with x m A and y in B. Prove that 
sup(A+B) = sup A+sup B. Hint: ‘The mequality sup(A+B) < sup A+sup B 
is casy. Why? ‘To prove that sup A + sup B < sup(A + B) it suffices to prove 
that sup A + sup B < sup(A + B)+ 6 for all ¢ > 0; begin by choosing x. in A 
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aud y in B with sup A ~— x < €/2 and sup B — y < &/2. 
CURE | <—<—@ —| << are ime 


(a) Consider a sequence of closed intervals 1; = {a,, by]. 12 = [a2, b2],.... 
< ay41 and b,41 < b, for all n (Figure 8). Prove that 


Suppose that a, 
there ts a point x which is m every [y. 

(b) Show that this conclusion is false if we consider open intervals instead of 
closed intervals. 


‘The simple result of Problem 14(a) is called the “Nested Interval Theorem.” It 


may be used to give alternative proofs of Theorems | and 2. The appropriate 


reasoning, outlined in the next two problems, illustrates a general method, called 


a “bisecuon argument.” 


oa lam 


*16. 


Py. 


*18. 


Suppose f is continuous on [a,b] and f(a) < 0 < f(b). Then either 
f((a + b)/2) = 0, ov f has different signs at the end points of the interval 
[a, (a + b)/2], or f has different signs at the end points of [(a + b)/2, b]. 
Why? If f(a + b)/2) 4 0, let 1; be the interval on which f changes sign. 
Now bisect J). Either f is 0 at the midpomt, or f changes sign on one of the 
two mtervals. Let /> be that interval. Continue in this way, to define /, for 
each n (unless f is 0 at some midpoint). Use the Nested Interval Theorem 
to find a point x where f(x) = 0. 


Suppose f were contnuous on [a,b], but not bounded on [a,b]. Then f 
would be unbounded on either [a, (a+)/2] or |(a+b)/2, b]. Why? Let /; 
be one of these intervals on which f 1s unbounded. Proceed as in Problem 15 
to obtam a contradiction. 


(a) Let A= {x:x <a}. Prove the following (they are all easy): 


(i) If x isin A and y < x, then y isin A. 


(pA =). 
(i) AZAR. 
(iv) If x is in A, then there ts some number x’ in A such that x < x’, 
(b) Suppose, conversely, that A satisfies (i)-(iv). Prove that A = {x i: x < 
sup A}. 


A number x is called an almost upper bound for A if there are only 
finitely many numbers y in A with y > x. An almost lower bound is 


defined siniilarly. 


(a) Find all almost upper bounds and almost lower bounds of the sets in 
Problem 1. 

(b) Suppose that A is a bounded infinite set. Prove that the set B of all 
almost upper bounds of A is nonempty, and bounded below. 
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(c) It follows from part (b) that inf B exists; this number is called the limit 
superior of A, and denoted by lim A or lim sup A. Find lim A for each 
set A in Problem I. 

(d) Define lim A, and find it for all A in Problem I. 


*19. If A isa bounded infinite set prove 
(a) lim A <lmA. 


(b) limA < sup A. 


(c) If lim A < sup A, then A contains a largest element. 
(d) ‘The analogues of parts (b) and (c) for lim. 


ine oe a 


shadow points 


PIG URE 9 


20. Let f be a continuous function on R. A pomt x is called a shadow point 
of f if theres a number y > x with f(y) > f(x). The rationale for this 
terminology is dicated in Figure 9; the parallel lines are the rays of the sun 
rising m the east (you are facing north). Suppose that all pomts of (a,b) are 
shadow pomts, but that a and b are not shadow pomts. Clearly, f(a) > f(b). 


(a) Suppose that f(a) > f(b). Show that the point where f takes on its 
maximum value on [a,b] must be a. 

(b) ‘Phen show that this leads to a contradiction, so that in fact we must have 
Ta) =a) (bp): 
This little result, known as the Rismg Sun Lemma, is instrumental m 


proving several beautiful theorems that do not appear mi this book; see 
page 450. 
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DEFINITION 


APPENDIX. UNIFORM CONTINUITY 


Now that we’ve come to the end of the “foundations,” it might be appropriate 
to slip in one further fundamental concept. ‘This notion is not used crucially in 
the rest of the book, but it can help clarify many points later on. 

We know that the function f(x) = x? is continuous at a for all a. In other 
words, 


if a is any number, then for every ¢ > 0 there is some 5 > O 
~ . S) 9) 
such that, for all x, if |x —a| < 6, then |x“ —a7| <e. 


Of course, 6 depends on ¢. But 6 also depends on athe 6 that works at a might 
not work at b (Figure 1). Indeed, it’s clear that given ¢ > 0 there is no one 6 > 0 
that works for all a, or even for all positive a. In fact, the number a + 6/2 will 
certainly satisfy |x — a| < 6, but if a > 0, then 


eS = @ ol aac ear = G0. 


and this won't be < € once a > €/8. (This is just an admittedly confusmg compu- 
tational way of saying that f is growing faster and faster!) 

On the other hand, for any ¢ > 0 there will be one 5 > 0 that works for all a 
in any interval [—N, N]. In fact, the 6 which works at N or —N will also work 
everywhere else in the interval. 

As a final example, consider the function f(x) = sin 1/x, or the function whose 
eraph appears in Figure 18 on page 62. It is easy to see that, so long as € < lL 
there will not be one 5 > 0 that works for these functions at all points a m the 
open interval (0, 1). 

These examples illustrate important distinctions between the behavior of various 
continuous functions on certain intervals, and there is a special term to signal this 
distinction. 


The function f is uniformly continuous on an interval A if for every ¢ > 0 
there is some 5 > O such that, for all x and y in A, 


i (oy | es Omtier eye CY pe. 


We've seen that a function can be continuous on the whole line, or on an open 


interval, without being uniformly continuous there. On the other hand, the func- 
fiom f(x) = x? did turn out to be uniformly continuous on any closed interval. 
This shouldn’t be too surprising it’s the same sort of thing that occurs when we 
ask whether a function is bounded on an interval aud we would be led to suspect 
that any continuous function on a closed interval is also uniformly continuous On 
that interval. In order to prove this, we'll need to deal first with one subtle pomt. 

Suppose that we have two intervals [a,b] and [. ce} with the common end- 
point b, and a function f that is continuous on [a,c]. Let e > 0 and suppose that 


ee ee 
a 5 c 
PG COREE 2 
LEMMA 
PROOF 
THEOREM 1 
PROOF 
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the following two statements hold: 


(1) if x and y are in [a, b| and |x — y| < 4), then |f(«)— fQ)| <e, 
(11) if mand ¥ are im |b, c)and |x — y|j= 65. then @) Seta — ee: 


We'd like to know if there is some 6 > 0 such that | f(x) — f(y)| < © whenever 
x and y are points in [a,c] with |v — y| < 6. Our first inclination might be to 
choose 6 as the minimum of 46; and 62. But it is easy to see what goes wrong 
(Figure 2): we might have x in [a,b] and y in [b,c], and then neither (1) nor (1) 
tells us anything about | f(x) — f(y)|. So we have to be a little more cagey, and 
also use continuity of f at b. 


Let a < b < c and let f be continuous on the interval [a,c]. Let ¢ > 0, and 
suppose that statements (i) and (11) hold. Then there is a 6 > 0 such that, 


if x and y are m [a,c] and |x — y| < 6, then | f(x) — f(y)| < e. 


Since f 1s continuous at b, there is a 63 > O such that, 


if |v — b| < 53, then | f(x) — f(b)| < >. 


It follows that 
(uy) if [x — b| < 63 and |y — b| <z¢sthens| f(x) —F(y)| < €. 


Choose 6 to be the minimum of 4), 69, and 463. We claim that this 6 works. In 
fact, suppose that x and y are any two points in [a,c] with |x — y| < 6. If x and y 
are both in [a, b], then | f(x) — f(y)| < € by (i); and if x and y are both in [b,c], 
then | f(x) — f(y)| < & by (1). The only other possibility is that 


ic Dey or Vp a 


In either case, since |x — y| < 6, we also have 


Lf(x) — f(y)| < € by (i). Jf 


x — b| < 6 and |y — b/ = 6. So 


If f is continuous on [a, b], then f is uniformly continuous on [a, b]. 


It’s the usual trick, but we’ve got to be a little bit careful about the mechanism of 
the proof. For e > 0 let’s say that f is e-good on [a, b| if there is some 6 > 0 such 
that, for all y and z m [a, 5], 


if ly — | < 6, then | f(y) — f@)| <e. 
Then we're trying to prove that f is e-good on [a, b] for all ¢ > 0. 
Consider any particular ¢ > 0. Let 
A={x:a<x <band f is e-good on [a. x]}. 
Then A # & (since a is in A), and A is bounded above (by b), so A has a least 


upper bound @. We really should write @,, since A and @ night depend on ¢. But 
we won't since we intend to prove that a = b, no matter what ¢ is. 
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Suppose that we had @ < b. Since f is continuous at a, there is some dg > 0 
such that, if |y —a@| < dg, then |f(y) — f(@)| < €/2. Consequently, if |y —a| < d9 
and |z —a@| < do, then | f(y) — f(2)| < €. So f is surely ¢-good on the interval 
[a — d9.@ + d9]. On the other hand, since @ is the least upper bound of A, it 
is also clear that f is e-good on [a,@ — do]. Then the Lemma implies that f is 
e-good on [a.@ + dg], so a + dg is in A, contradicting the fact that @ is an upper 
bound. 

To complete the proof we just have to show that a = b is actually in A. The 
argument for this 1s practically the same: Since f 1s continuous at b, there is some 
d9 > 0 such that, if b — 69 < y < b, then | f(y) — f(b)| < €/2. So f is €-good on 
[b — 49, b]. But f 1s also e-good on [a,b — dg], so the Lemma implies that f is 
e-good on [a,b]. § 


PROBLEMS 


® uni- 


1. (a) For which of the followmg values of @ is the function f(x) = x 
forinly conatiteus oni [0,co)s a =eh/3, 1/2, 2, 3? 
(b) Find a function f that is contmuous and bounded on (0, 1], but not 
uniformly continuous on (Q, 1]. 
(c) Find a function f that is continuous and bounded on [Q, 00) but which 


is not uniformly continuous on [0, 00). 


2. (a) Prove that if f and g are uniformly continuous on A, then so is f + g. 
(b) Prove that if f and g are uniformly continuous and bounded on A, then 
fg is uniformly continuous on A. 
(c) Show that this conclusion does not hold if one of them isn’t bounded. 
(d) Suppose that f is uniformly continuous on A, that g is uniformly con- 
tinuous on B, and that f(x) is in B for all x in A. Prove that go f is 
uniformly continuous on A. 


3. Use a “bisection argument” (page 142) to give another proof of Theorem I. 


4. Derive Theorem 7-2 as a consequence of Theorem 1. 


PART @} 


DERIVATIVES 
AND 
INTEGRALS 


In 1604, at the height of 

his scientific career, Galileo argued 
that for a rectilinear motion 

in which speed increases proportionally 
to distance covered, 

the law of motion should be 

est Wiat (% =i) 

which he had discovered 

in the investigation of falling bodies. 
Between 1695 and 1700 

not a single one of the monthly issues 
of Leipzig’s Acta Eruditorum was published 
without articles of Leibniz, 

the Bernoull: brothers 

or the Marquis de (Hopital treating, 
with notation only slightly different from 
that which we use today, 

the most varied problems of 
differential calculus, integral calculus 
and the calculus of variations. 

Thus in the space of almost precisely 
one century 

infinitesimal calculus or, 

as we now call it in English, 

The Calculus, 

the calculating tool par excellence, 

had been forged; 

and nearly three centuries of 

constant use have not completely dulled 
this incomparable instrument. 
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FIGURE 2 


CHAPTER 


DERIVATIVES 


The derivative of a function is the first of the two major concepts of this section. 
Together with the mtegral, it constitutes the source from which calculus derives 
its particular flavor. While it is true that the concept of a function is fundamental, 
that you cannot do anything without limits or continuity, and that least upper 
bounds are essential, everything we have done until now has been preparation-—if 
adequate, this section will be easier than the preceding ones—for the really exciting 
ideas to come, the powerful concepts that are truly characteristic of calculus. 

Perhaps (some would say “certainly”) the interest of the ideas to be introduced 
in this section stems from the intimate connection between the mathematical con- 
cepts and certain physical ideas. Many definitions, and even some theorems, may 
be described in terms of physical problems, often in a revealing way. In fact, the 
demands of physics were the original mspiration for these fundamental ideas of 
calculus, and we shall frequently mention the physical interpretations. But we 
shall always first define the ideas in precise mathematical form, and discuss their 
significance in terms of mathematical problems. 

The collection of all functions exhibits such diversity that there is almost no 
hope of discovermg any interesting general properties pertaining to all. Because 
continuous functions form such a restricted class, we might expect to find some 
nontrivial theorems pertaining to them, and the sudden abundance of theorems 
afier Chapter 6 shows that this expectation ts justified. But the most mteresting 
and most powerful results about functions will be obtained only when we restrict 
our attention even further, to functions which have even greater claim to be called 
“reasonable,” which are even better behaved than most continuous functions. 


FO) = |k|,% = 0 
FC) = x7,x <0 


foe — in| 


Viel 


FIGURE J (a) (b) 


Figure | illustrates certam types of misbehavior which continuous functions can 
display. The graphs of these functions are “bent” at (0,0), unlike the graph of 
Figure 2, where it is possible to draw a “tangent line” at each point. The quotation 
marks have been used to avoid the suggestion that we have defined “bent” or 
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FIGURE 4 


“tangent line,” although we are suggesting that the graph might be “bent” at a 
pomt where a “tangent line” cannot be drawn. You have probably already noticed 
that a tangent line cannot be defined as a line which intersects the graph only 
once—such a definiuon would be both too restrictive and too permissive. With 
such a definition, the straight line shown in Figure 3 would not be a tangent line 
to the graph in that picture, while the parabola would have two tangent lines at 
each point (Figure 4), and the three functions in Figure 5 would have more than 
one tangent line at the points where they are “bent.” 


(a) (b) (c) 


ECCLES 


A more promising approach to the definition of a tangent line might start with 
“secant lines,” and use the notion of limits. If 4 4 0, then the two distinct points 
(a, f(a)) and (a +h, f(a +h)) determine, as in Figure 6, a straight line whose 
slope 1s 

fla+h) — fla) 
h 


(ath, fat+h)) 


flat+h)— fa 


EVGIWRT: 6 


As Figure 7 illustrates, the “tangent line” at (a, f(@)) seems to be the limit, m 
some sense, of these “secant lines,” as f approaches 0. We have never before 
talked about a “hnut” of lines, but we can talk about the limit of their slopes: the 


RSE 7 


DEFINITION 


if (a, f(a)) 


a 
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slope of the tangent line through (a, f(a)) should be 
pee er i) — 7) 
1s eeenceeaneea 
h-0 h 


We are ready for a definition, and some comments. 


The function f is differentiable at a if 


. fla+h)— fla) 
——— 


exists. 
h-0 h 


In this case the limit is denoted by f’(a) and is called the derivative of f at 
a. (We also say that f is differentiable if f is differentiable at a for every a 
in the domain of f/f.) 


The first comment on our definition is really an addendum; we define the 
tangent line to the graph of f at (a, f(a)) to be the line through (a, f(a)) 
with slope f’(a). This means that the tangent line at (a, f(a)) 1s defined only if 
f is differentiable at a. 

The second comment refers to notation. The symbol f’(a) is certainly rem- 
iniscent of functional notation. In fact, for any function f, we denote by f’the 
function whose domain is the set of all numbers a such that f is differentiable 
at a, and whose value at such a number a is 


. flath)— fa) 
ee 
h-0 h 


(lo be very precise: f’ is the collection of all pairs 


( . flath)— 7 
(fie lim (SS 


h—0 h 
for which iy | flath)— f(a)|/h exists.) The function f’ is called the derivative 
= 

Gls 

Our third comment, somewhat longer than the previous two, refers to the phys- 
ical interpretation of the derivative. Consider a particle which is moving along a 
straight line (Figure 8(a)) on which we have chosen an “origin” point O, and a 
direction in which distances from O shall be written as positive numbers, the dis- 
tance from O of points in the other direction bemg written as negative numbers. 
Let s(t) denote the distance of the particle from O, at time rt. ‘The suggestive nota- 
tion s(t) has been chosen purposely; since a distance s(t) is determined for each 


motion of the particle 
t=) is 


line along which particle is moving 
FIGURE 87 aj 
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“distance” 


graph of s 


FIGURE 8(b) 


+ 


“time” 


number f, the physical situation automatically supplies us with a certain function s. 
‘The graph of s indicates the distance of the particle from O, on the vertical axis, 
in terms of the time, indicated on the horizontal axis (Figure 8(b)). 
The quotient 
S(C ode) & Sha) 
h 

has a natural physical interpretation. It is the “average velocity” of the particle 
during the time interval from a to a +h. For any particular a, this average speed 
depends on fh, of course. On the other hand, the limit 


. s(ath) —s(a) 
ling. ——————— 
h-0 h 


depends only on a (as well as the particular function s) and there are important 
physical reasons for considering this limit. We would like to speak of the “velocity 
of the particle at time a,” but the usual definition of velocity is really a definition 
of average velocity; the only reasonable definition of “velocity at time a” (so-called 
“instantaneous velocity’) is the limit 


. sath) —s(a) 
hia. —————_-— 
h—0O h 


Thus we define the (instantaneous) velocity of the particle at a to be s’(a). 
Notice that s’(a) could easily be negative; the absolute value |s’(a)| 1s sometimes 
called the (instantaneous) speed. 

It is important to realize that mstantaneous velocity is a theoretical concept, 
an abstraction which does not correspond precisely to any observable quantity. 
While it would not be fair to say that instantaneous velocity has nothing to do 
with average velocity, remember that s’(t) 1s not 


s(t th) —s(t) 
h 


for any particular f, but merely the limit of these average velocities as fh ap- 
proaches 0. ‘Thus, when velocities are measured in physics, what a physicist really 
measures is an average velocity over some (very small) time interval; such a pro- 
cedure cannot be expected to give an exact answer, but this is really no defect, 
because physical measurements can never be exact anyway. 

The velocity ofa particle 1s often called the “rate of change of its position.” ‘This 
notion of the derivative, as a rate of change, apphes to any other physical situation 
in which some quantity varies with time. For example, the “rate of change of 
mass” of a growmeg object means the derivative of the function m, where m(t) 1s 
the mass at time f. 

In order to become familiar with the basic definitions of this chapter, we will 
spend quite some time examining the derivatives of particular functions. Before 
proving the important theoretical results of Chapter 11, we want to have a good 
idea of what the derivative of a function looks like. "Phe next chapter is devoted 
exclusively to one aspect of this problem calculating the derivative of comphi- 
cated functions. In this chapter we will emphasize the concepts, rather than the 


PRGURE 9 


slope 2a 


(a,a°) 
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calculations, by considermg a few simple examples. Simplest of all is a constant 
function, f(x) =c. In this case 

flat+h) — fa) CSc 
ee 


hi = lim 
h—0O h h-0 h 


=). 


Thus f is differentiable at a for every number a, and f’(a) = 0. This means that 
the tangent line to the graph of f always has slope 0, so the tangent line always 
coincides with the graph. 

Constant functions are not the only ones whose graphs coincide with their tan- 
gent lines—this happens for any linear function f (+) = cx +d. Indeed 


“ lath) — fla) 


h>0 h 
_. €(a@+h) +d — [ca +d] 
= ———————— 
h>0 h 
ae 
= limi— = c: 
h—-0O fl 


the slope of the tangent line is c, the same as the slope of the graph of ff. 


; Byes ; 9 
A refreshing difference occurs for f(x) = x+~. Here 


oes, 
f'(a) = lim fla+h)— fla 
h—0 h 
_ (ath) -a? 
= lim ————_- 
h—0 h 
_ at? +2ch Fe = a? 
= lm ——c 
h>0 h 
= lim 2a +h 


h— 


— 2 


Some of the tangent lines to the graph of f are shown in Figure 9. In this picture 
each tangent line appears to intersect the graph only once, and this fact can be 

. . . . a) 9 . 
checked fairly easily: Since the tangent line through (a, a~) has slope 2a, it is the 
graph of the function 


g(x) = 2a(x —a) +a" 
93 
= 2h — ao, 


Now, if the graphs of f and g intersect at a point (x, f(x)) = (x, g(v)), then 


x? = 2ax — a? 
or x? =—2ax +a* =0: 
so (x—a)* =0 
Or. gy Ue 


2) : . ys . 
In other words, (a, a“) 1s the only pomt of intersection. 
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+ . Di; . . . . 
The function f(«) = x happens to be quite special in this regard; usually a 
tangent line will intersect the graph more than once. Consider, for example, the 
function f(x) = x?. In this case 


(a) = fy ee) 


h—0 h 
GG -hy —a 
= hm ——————_ 
h—-O h 
— a4+3a2h + 3ah? +43 -— 2 
= hm — 
h--0 h 
, 3a7h + 3ah? +h3 
= hm —————————_- 
h—0 h 
— aftyh 3a? + 3ah 4+ h? 
h— 
=a 


Thus the tangent line to the graph of f at (a, a>) has slope 3a?. This means that 
the tangent line 1s the graph of 


ee 3a2(x aera 
— 3a*x — 2a. 


‘The graphs of f and g intersect at the point (x, f(*)) = (, g(x) when 


0) 
x = Batmeai2a° 


i 
OF cB tao OU 


This equation ts easily solved if we remember that one solution of the equation 
has got to be x = a, so that (x — a) 1s a factor of the left side; the other factor can 
then be found by dividing, We obtain 


(x — a)(x- + ax — 2a") = (). 


) 5) . 7 
It so happens that x* + ax — 2a“ also has x — a as a factor; we obtain finally 


(x — a)(x — a)(x + 2a) = 0. 


slope 3a? 
Thus, as illustrated in Figure 10, the tangent line through (a, a+) also intersects 
—2a the graph at the point (—2a, —8a3). These two points are always distinct, except 
. Wien =. 0: 

We have already found the derivative of sufficiently many functions to illustrate 
the classical, and still very popular, notation for derivatives. Vor a given function f, 
the derivative f’ is often denoted by 


df (Xx) 


dx 


mGWRE Lo lor example, the symbol 


ax 


dx 
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4 . . ~ 9 
denotes the derivative of the function f(x) = x-. Needless to say, the separate 
parts of the expression 


df (x) 


dx 


are not supposed to have any sort of independent existence — the d’s are not num- 
bers, they cannot be canceled, and the entire expression is not the quotient of two 
other numbers “df(x)” and “dx.” ‘This notation is due to Leibniz (generally 
considered an independent co-discoverer of calculus, along with Newton), and is 
affectionately referred to as Leibnizian notation.* Although the notation df (+)/dx 
seems very complicated, in concrete cases it may be shorter; after all, the symbol 
dx*/dx is actually more concise than the phrase “the derivative of the function 
ee 

The following formulas state in standard Leibnizian notation all the information 
that we have found so far: 


dc 
==), 
dx 
d(ax + b) 
——_—— =a, 
dx 
Oe a5 
ax 
1x3 
eile Soe 
dx 


Although the meaning of these formulas is clear enough, attempts at literal 
interpretation are hindered by the reasonable stricture that an cquation should 
not contain a function on one side and a number on the other. For example, if 
the third equation is to be true, then either df(x)/dx must denote f’(x), rather 
than f’, or else 2x must denote, not a number, but the function whose value at x 
is 2x. It is really impossible to assert that one or the other of these alternatives is 
intended; in practice df(x)/dx sometimes means f’ and sometimes means f’(v), 
while 2x may denote either a number or a function. Because of this ambiguity, 
most authors are reluctant to denote f(a) by 


df (x) ey 
dx 


instead f’(a) is usually denoted by the barbaric, but unambiguous, symbol 


df (x) 


dx 


xX=a 


* Leibniz was led to this symbol by his intuitive notion of the derivative, which he considered to be, 
not the hmit of quotients [f(x +h) — f(x)|/A, but the “value” of this quotient when /7 is an “infiniteh 
small” number. ‘This “infmitely small” quantity was denoted by dx and the corresponding “infinitely 
small” difference f(x+dx)— f(x) by df (x). Although this point of view is impossible to reconcile with 
properties (P1)-(P13) of the real numbers, some people find this notion of the derivative congenial. 
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In addition to these difficulties, Leibnizian notation is associated with one more 
ambiguity. Although the notation dx?/dx is absolutely standard, the notation 
df (x)/dx is often replaced by df/dx. This, of course, is in conformity with the 
practice of confusing a function with its value at x. So strong is this tendency that 
functions are often indicated by a phrase like the following: “consider the function 
y = x7.” We will sometimes follow classical practice to the extent of using y 
as the name of a function, but we will nevertheless carefully distinguish between 
the function and its values~—thus we will always say something like “consider the 
function (defined by) y(x) = x2.” 


Despite the many ambiguities of Leibnizian notation, it is used almost exclu- 
sively in older mathematical writing, and is still used very frequently today. The 
staunchest opponents of Leibnizian notation admit that it will be around for quite 
some time, while its most ardent admirers would say that it will be around for- 
ever, and a good thing too! In any case, Leibnizian notation cannot be ignored 
completely. 


The policy adopted in this book is to disallow Leibnizian notation within the 
text, but to include it in the Problems; several chapters contain a few (immediately 
recognizable) problems which are expressly designed to illustrate the vagaries of 
Leibnizian notation. ‘Trusting that these problems will provide ample practice in 
this notation, we return to our basic task of examining some simple examples of 
derivatives. 

The few functions examined so far have all been differentiable. ‘To fully ap- 
preciate the significance of the derivative it is equally important to know some 
examples of functions which are not differentiable. ‘The obvious candidates are the 
three functions first discussed in this chapter, and illustrated in Figure 1; if they 
turn out to be differentiable at 0 something has clearly gone wrong. 


Gonsider‘tirst ( () = |x|zeInethis ease 


f(+h)— f(O) fA 


h ho 


Now 


h{/h = 1 for h > 0, and |h|/h = —1 for h < 0. This shows that 


i fh) — fO) 
im. ——— 


h—0O h 


does not exist. 


In fact, 


fh) — fO) _ 


lim —a 
h>0+ h 
. f@=fO) 
and lin. ———_——— = —]. 
h—0 h 


(These two limits are sometimes called the right-hand derivative and thie left- 
hand derivative, respectively, of f at 0.) 


9. Derivatives 157 


If a #0, then f’(a) does exist. In fact, 


if if Cap 1 it» 0) 
Co — ll tix <0. 


The proof of this fact is left to you (it 1s easy if you remember the derivative of a 
linear function). The graphs of f and of f’ are shown in Figure 11. 


‘i For the function 
————EE 
eae a a (0) 
HENS x, 6 =10; 
li a similar difficulty arises in connection with f’(0). We have 
—_——————> 
h 
FIGURE 11 f(h) — fO) _ Fa h<0O 
h fae 
ii (ey ess (0) 
h 
y Therefore, 
‘(h) — fO 
lim LH) — FO) ==!) 
h—0- h 
_ fthy— f(O) 
but lm ——¥——— =]. 
h—0O+ h 
Thus f’(O) does not exist; f is not differentiable at 0. Once again, however, f’(x) 
exists for x # 0—1t is easy to see that 
Te 
—_ “5 Doge x0) 
f(xH= 
le sass (0) 
The graphs of f and f’ are shown in Figure 12. 
f! Even worse things happen for f(x) = /|x|. For this function 
Jn 
— = —, hi 0 
FIGURE 12 A et Oe h Sh 
h fh 
—} 
Haut . =! 
h —h 


In this case the right-hand limit 


f(x) = Vix! h—>0+ h h>0+ /h 
does not exist; instead 1/Vh becomes arbitrarily large as h approaches 0. And, 
what’s more, —1/V—h becomes arbitrarily large in absolute value, but negative 


(Figure 13). 


FIGURE 13 
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FIGURE 14 


THEOREM 1 


PROOF 


The function f(x) = Vx, although not differentiable at 0, is at least a little 
better behaved than this. ‘The quotient 
- 3 
ff) — fO) a Ai? I 
h * quvligarcenlt ie a 
simply becomes arbitrarily large as h goes to 0. Sometimes one says that f has 


an “infinite” derivative at 0. Geometrically this means that the graph of f has a 
“tangent Ine” which is parallel to the vertical axis (Figure 14). Of course, f(x) = 


— Vx has the same geometric property, but one would say that f has a derivative 
of “negative infinity” at 0. 

Remember that differentiability is supposed to be an improvement over mere 
contnuity. ‘Uhis idea is supported by the many examples of functions which are 
continuous, but not differentiable; however, one important point remains to be 
noted: 


If f is differentiable at a, then f 1s continuous at a. 


him. fla +h) — f(a) = hm ACSA eee h 


h—-O h 
oe Ge (a 
= lim ———————_ - lmh 
h-0 h h-O 
= f(a) -0 
=) 


As we pointed out in Chapter 5, the equation lim flat+h)— f(a) = 0 is equivalent 
h-> 


to lim f(x) = f(a): thus f is continuous at a. ff 
Be — of 


It is very important to remember Theorem 1, and just as important to remember 
that the converse is not true. A differentiable function 1s continuous, but a con- 
tinuous function need not be differentiable (keep in mind the function f(x) = |x|, 
and you will never forget which statement is true and which false). 

The continuous functions examined so far have been differentiable at all pomts 
with at most one exception, but it is easy to give examples of continuous functions 
which are not differentiable at several pomts, even an infinite number (Figure 15). 
Actually, one can do much worse than this. There is a function which ts continuous 


TACT, 1S 
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FIGURE 17 


(c) ~ 


FIGURE 16 


everywhere and differentiable nowhere! Unfortunately, the definition of this function will 
be inaccessible to us until Chapter 24, and I have been unable to persuade the 
artist to draw it (consider carefully what the graph should look like and you will 
sympathize with her point of view). It is possible to draw some rough approxima- 
tions to the graph, however; several successively better approximations are shown 


in Figure 16. 


Although such spectacular examples of nondifferentiability must be postponed, 
we can, with a little ingenuity, find a continuous function which is not differentiable 
at infinitely many points, all of which are in [O, 1]. One such function 1s illustrated in 
Figure 17. The reader is given the problem of defining it precisely; it is a straight 
line version of the function 


asmn—, + 0 


fx)= x 


This particular function /f is itself quite sensitive to the question of differentiability. 


Indeed, for h 4 0 we have 
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sank 
f@— {Our em ee! 
SS SS SSS SIM 


h h h 


Long ago we proved that lim sin 1/h does not exist, so f 1s not differentiable at 0. 
| 


1i—_> 


Geometrically, one can see that a tangent line cannot exist, by noting that the 
secant line through (0,0) and (h, f(h)) in Figure 18 can have any slope between 
—1 and 1, no matter how small we require h to be. 


FIGURE 18 


This finding represents something of a triumph; although continuous, the func- 
tion f seems somehow quite unreasonable, and we can now enunciate one math- 
ematically undesirable feature of this function—it is not differentiable at 0. Nev- 
ertheless, one should not become too enthusiastic about the criterion of differen- 
tiability. For example, the function 


ACS x* sin me ae (0) 
0 x = 0 
is differentiable at 0; in fact g’(O) = 0: 
has I 
7(h) — 2(0 j= Sia 
lim sts) =i lita h 
h>0 h h>0 Ah 


; te 
= lim A sin — 
h>0 h 


=i (()) 


The tangent line to the graph of g at (0,0) is therefore the horizontal axis (Fig- 
ure 19). 

This example suggests that we should seek even more restrictive conditions on a 
function than mere differentiability. We can actually use the derivative to formulate 
such conditions if we introduce another set of definitions, the last of this chapter. 
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For any function f, we obtain, by taking the derivative, a new function f’ (whose 
domain may be considerably smaller than that of f). The notion of differentia- 
bility can be applied to the function f’, of course, yielding another function (/7)’, 
whose domain consists of all pomts a such that f’ is differentiable at a. The func- 
tion (f’)’ is usually written simply f” and is called the second derivative of /f. 
If f(a) exists, then f is said to be 2-times differentiable at a, and the number 
f(a) is called the second derivative of f at a. 

In physics the second derivative is particularly important. If s(t) is the posi- 
tion at time ¢ of a particle moving along a straight line, then s”(t) is called the 
acceleration at time f. Acceleration plays a special role in physics, because, as 
stated in Newton’s laws of motion, the force on a particle is the product of its mass 
and its acceleration. Consequently you can feel the second derivative when you 
sit in an accelerating car. 

There is no reason to stop at the second derivative we can define f” = (f")', 
f= (f'"Y,, ete. This notation rapidly becomes unwieldy, so the followmg abbre- 
viation is usually adopted (it 1s really a recursive definition): 


Ve! = ee 
Filsab a Ce 


Thus 


: i 
lll 
2 


The various functions f“, for k > 2, are sometimes called higher-order 
derivatives of f. 

Usually, we resort to the notation f only for k > 4, but it is convenient to 
have f defined for smaller k also. In fact, a reasonable definition can be made 
fo 


for f*', namely, 


fO =f. 
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if CO =e 
(a) 
i Cy — 2x 
(b) 
fe) = 2 


oo 


f(x) =0,k >3 


 - 


(d) 


FIGURE 20 


Leibnizian notation for higher-order derivatives should also be mentioned. ‘The 
natural Leibnizian symbol for f”(x), namely, 


d (=) 
dx 


dx 


is abbreviated to 


d* f (x) d? f (x) 


a or more frequently to 
(dx)? ‘4 y dx? 


Similar notation is used for f(x). 

The following example illustrates the notation f“, and also shows, in one very 
simple case, how various higher-order derivatives are related to the original func- 
tion. Let f(x) = x7. Then, as we have already checked, 


if Caan, 
fiz, 
yf @) = 0, 


f!@)=0, fk>=3. 


Figure 20 shows the function f, together with its various derivatives. 
A rather more illuminating example is presented by the following function, 
whose graph is shown in Figure 21 (a): 


It is easy to see that 


i @Q= 2a eta]; 
f{@M==2a ta=0. 


Moreover, 
h)— f(O 
/'0) in 
h—0 h 
we) 
=allitan 
h>0 h 
Now 
(} h? 
lim F@) = lim ia =(() 
RS05) oh h>0+ h 
x; —h? 
and ~~ lim I) = lim aS 0, 
h>0- A h>0- Ah 
Ye) . 
fh) 


f'(O) = lim 
h>0 


= (), 
This information can all be summarized as follows: 


f= elk 


ea Bee ve U0 
fay=|* | 
(a) 
Fi) = 2\x| 
(b) 
f'() =2,x>0 
fC): =e--2, <0 
(c) 


PIGURE 21 
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It follows that f”(O) does not exist! Existence of the second derivative is thus a 
rather strong criterion for a function to satisfy. Even a “smooth looking” function 
like f reveals some irregularity when examined with the second derivative. ‘This 
suggests that the irregular behavior of the function 


7a seme 
X~ Sin =, Meee) 
a: 
0, C=O 


might also be revealed by the second derivative. At the moment we know that 
g(O) = 0, but we do not know g’(a) for any a 4 0, so it is hopeless to begin 


g(x) = 


computng g”(O). We will return to this question at the end of the next chapter, 
after we have perfected the technique of finding derivatives. 


PROBLEMS 
1. (a) Prove, working directly from the definition, that if f(v) = I/x, then 
f(a) = —1/a?’, fora £0. 
(b) Prove that the tangent line to the graph of f at (a, |/a) does not intersect 
the graph of f, except at (a, 1/a). 


2. (a) Prove that if f(x) = 1/x, then f’(a) = —2/a? for a £0. 
(b) Prove that the tangent line to f at (a, 1/a7) intersects f at one other 
point, which lies on the opposite side of the vertical axis. 


3. Prove that if f(x) = J/x. then f’(a) = 1/(2,/a), for a > 0. (The expression 
you obtain for [f(a +h) — f(a)|/h will require some algebraic face lifting, 
but the answer should suggest the right trick.) 


4, For each natural number n, let S,(x) = x”. Remembering that S;’(x) = I, 
o> apes ancl 53 (x) = 3x2, conjecture a formula for S,'(x). Prove your 
conjecture. (The expression (x +h)” may be expanded by the bmomial 
theorem.) 


5. lini sities (us) =s [ox |. 
6. Prove, starting from the definition (and drawing a picture to illustrate): 
Qiiee() — 9 (x)-ec."then 2’ (x)= £ @; 


(omer) — cf ojmethient®s’ (x) = cf’). 


7. Suppose that f(x) = x. 


(a) What is f’(9), f’(25),, f'G6)? 

(b) What is f’(37). f’(5), £'(67)? 

(c) What is f'(a*), f'@7)? 

If you do not find this problem silly, you are missing a very mportant point: 
ee) means the derivative of f at the number which we happen to be 
calling x2: it is not the derivative at x of the function dec Fo Tee Just to 
drive the pomt honic: 


(lore) (ee x, compare Ff @-) and 9’(x) where-e(+) = f (7). 
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10. 


ll. 


12 


(a) Suppose g(x) = f(x+c). Prove (starting from the definition) that g’(x) = 
f(x +c). Draw a picture to illustrate this. To do this problem you must 
write out the definitions of g’(x) and f’(x +) correctly. ‘The purpose 
of Problem 7 was to convince you that although this problem is easy, it 1s 
not an utter triviality, and there is something to prove: you cannot simply 
put prime marks into the equation g(x) = f(x +c). ‘To emphasize this 
point: 

(b) Prove that if g(x) = f(ex), then. g’(x) =c- f'(ex). Try to see pictorially 
why this should be true, also. 

(c) Suppose that f is differentiable and periodic, with period a (ie., 
f(x +a) = f(x) for all x). Prove that f" is also periodic. 


Find f’(x) and also f’(x + 3) in the following cases. Be very methodical, 
or you will surely shp up somewhere. Consult the answers (after you do the 
problem, naturally). 


Gi) me AC = & = 3). 

Til Megat weees ps ce 

(ii) f(x t+3)=( +5)’. 

Find f(x) if f(x) = e(f +x), and if f(t). = g(t + x). The answersowill not 
be the same. 


(a) Prove that Galileo was wrong: if'a body falls a distance s(t) in f seconds, 
and s’ is proportional to s, then s cannot be a function of the form 
SCC. 

(b) Prove that the following facts are true about s if s(t) = (a/2)t? (the first 
fact will show why we switched from ¢ to a/2): 


(i) s(t) =a (the acceleration is constant). 
(ii) [s’(t)]? = 2as(t). 


(c) If s is measured in feet, the value of a is 32. How many seconds do you 
have to get out of the way of a chandeher which falls from a 400-foot 
ceilmg? If you don't make it, how fast will the chandelier be gong when 
it hits you? Where was the chandeher when it was moving with half that 
speed? 


Imagine a road on which the speed Imut is specified at every smgle poimt. In 
other words, there is a certain function L such that the speed hut x miles 
from the beginning of the road is L(x). ‘Two cars, A and B, are driving along 
this road; car A’s position at me f is a(t), and car B’s is b(t). 


(a) What equation expresses the fact that car A always travels at the speed 
limit? (The answer is not a’(t) = L(t).) 

(b) Suppose that A always goes at the speed limit, and that B’s position at 
time f is A’s position at time t— 1. Show that B is also gome at the speed 
limit at all times. 

(c) Suppose, mstead, that B always stays a constant distance behind A. Un- 
der what conditions will B sull always travel at the speed hmit? 


4 


13. 


14, 


15. 


16. 
We 


+18. 


Je 


20. 


FaGae RoE 22 
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Suppose that f(a) = g(a) and that the left-hand derivative of f at a equals 
the right-hand derivative of g at a. Define h(x) = f(x) for x < a, and 
h(x) =) tor 7a. Prove that /-is diflerentiable ata. 


Lég.G) = x? if x is rational, and f(x) = 0 if x is irrational. Prove that 
f is diflerentiable at 0. (Don't be scared by this function. Just write out the 


definition of f’(0).) 


(a) Let f be a function such at |f(x)| < x for all x. Prove that f is 
diflerentiable at 0. (If you have done Problem 14 you should be able to 
do this.) 

(b) This result can be generalized if x7 is replaced by |g(x)|, where g has 
what property? 


Let a > 1. If f satisfies | f(x)| < |x|*, prove that f is differentiable at 0. 


Let 0 < 6 < 1. Prove that if f satisfies | f(x)| > |x|? and f(O) = 0, then f 
is not diflerentiable at 0. 


ket f @) = OMerirmational x, and 1,/q for x = p/q in lowest terms. Prove 
that f is not differentiable at a for any a. Hint: It obviously suffices to prove 
this for irrational a. Why? If @ = m.ajaza3... 1s the decimal expansion 
of a, consider [| f(a +h) — f(a)|/h for h rational, and also for 


i= —0.00.. . OGyu pane? ~~. 


(a) ) Suppose*tliatey (jee (a)"= h(a), that f(x) = eg) ='hC@)Aorall_., 
and that f’(a) = h’(a). Prove that’g is differentiable at a, and that 
f'(a) = g'(a) = h(a). (Begin with the definition of g’(a).) 

(b) Show that the conclusion does not follow if we omit the hypothesis 


{[O=ga) We). 


Let f be any polynomial function; we will see in the next chapter that f 
is diflerentiable. The tangent lne to f at (a, f(@)) 1s the graph of g(x) = 
f'(ay(x — a) + f(a). Thus f(x) — g(x) is the polynomial function d(x) = 
f(x) — f(a — a) — f(a). We have already seen that if f(x) = x7, then 
d(x) = (x —a)?, and if noe = x3, then d(x) = (x — a)2(x + 2a). 


. ee eo 8 3) 
(a) Find d(x) when f(x) = x+, and show that it is divisible by (x — a)’. 
(b) ‘There certainly seems to be some evidence that d(x) is always divisible by 
; 2 Nay UE PS Se + See rere : a) ee -alle 
(x —a)-. Figure 22 provides an mtuitive argument: usually, lines parallel 
to the tangent line will intersect the graph at two points; the tangent Ime 
intersects the graph only once near the point, so the intersection should 
be a “double intersection.” ‘To give a rigorous proof, first note that 


d(x) be f(x) - f(@ 


xX — tt 2. 1G 


— f'(a). 


Now answer the following questions. Why 1s f(x) — f(a) divisible 
by (x — a)? Why is there a polynomial function fr such that A(x) = 
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226 


Zon 


24: 
207 


26. 


2. 


28) 


d(a)/(«'— a): forex -ia® Why iselanc (x)= 0? Why is f(a) = 0? Wihy 


Ee 
does this solve the problem? 
(a) Show that f’(a) = lhm[f(@) — f(a)]/(x — a). (Nothing deep here.) 
xa ‘ 
(b) Show that derivatives are a “local property”: if f(«) = g(x) for all x in 
some open interval containing a, then f’(a) = g’(a). (This means that 


in computing f’(a), you can ignore f(x) for any particular x 4 a. Of 
course you can't ignore f(x) for all such x at once!) 


(a) Suppose that f is differentiable at x. Prove that 
fx th) -— f(x -—h) 
2h 


Hint: Remember an old algebraic trick —a number is not changed if the 
same quantity 1s added to and then subtracted from it. 


ae) = lim 
h-0 


*(b) Prove, more generally, that 


: é f(x +h) — f(a -k) 
x)= ! ———————— 
J) as h+k 


Although we haven't encountered something like lim_ before, its mean- 
h,k 0 


ing should be clear, and you should be able to make an appropriate e-6d 
definition. ‘The important thing here is that we actually have hm _, so 


h,k>OF 
that we are only considering positive ft and k. 
Prove that if f is even, then f’(x) = —f’(—x). (In order to minimize con- 
fusion, let g(x) = f(—x); find g’(x) and then remember what other thing g 
is.) Draw a picture! 


Prove that if f is odd, then f’(x) = f’(—x). Once again, draw a picture. 


Problems 23 and 24 say that f’ is even if f is odd, and odd if f is even. 
What can therefore be said about f? 


Find f(x) if 

i) f@)=x°. 
ee) = x, 

(iii) Qe) = x". 
iv) f@+3)=~. 


if S, Cyan O"=<"k <7 P prove that 


ic ®) (x) = n! yk 
a” (n—k)t 


II 
= 
——— 
~~ SS 
SS 
~ 

R 


(a) Find f’(x) if f(x) = |x. Find f(x). Does f(x) exist for all x? 
(b) Analyze f sunilarly if f(x) = x? for x > 0 and f(x) = for x < 0) 


29: 


30. 
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Let f(x) =x" for x > O and let f(x) = 0 for x < 0. Prove that f~" exists 
(and find a formula for it), but that f (0) does not exist. 


Interpret the following specimens of Leibnizian notation; each is a restate- 
ment of some fact occurring in a previous problem. 


D dx” us n—1 

(1) re nx 
dz l l 
(11) ay — 2 iin = = 
Gi) dl f(x) +e] _ df (x) 
dx dx 
Gv) afef)] _ af) 
dx dx 
daze dys a 

(v) reese if 7= yr. 

< dx? 4 
(v1) Wag! ide — 3a , 

 Gf(x +a) df (x) 
(vu) ————— = : 

dx x=b dx x=b+a 

Gi ee eee 

dx x=b ‘ dx ae 
., Gf (cx) df(y) 
(ix) Sh Bis 

dx ay. es 


Che te n 
x Skt Neale 
) ax Ge 


CHAPTER 


THEOREM 1 


PROOF 


THEOREM 2 


PROOF 


DIFFERENTIATION 


The process of finding the derivative of a function 1s called differentiation. From the 
previous chapter you may have the impression that this process 1s usually laborious, 
requires recourse to the definition of the derivative, and depends upon successfully 
recognizing some limit. It is true that such a procedure is often the only possible 
approach—if you forget the definition of the derivative you are likely to be lost. 
Nevertheless, in this chapter we will learn to differentiate a large number of func- 
tions, without the necessity of even recalling the definition. A few theorems will 
provide a mechanical process for differentiating a large class of functions, which 
are formed from a few simple functions by the process of addition, multiplication, 
division, and composition. ‘This description should suggest what theorems will be 
proved. We will first find the derivative of a few simple functions, and then prove 
theorems about the sum, products, quotients, and compositions of differentiable 
functions. The first theorem is merely a formal recognition of a computation 
carried out in the previous chapter. 


If f is a constant function, f(x) = c, then 


f(a) =0 for all numbers a. 


ee ees 
7.2) — iim pS i) IC = im : 
h—0 h hoo h 


—0.§ 


The second theorem is also a special case of a computation in the last chapter. 


If f is the identity function, f(*) =x, then 


f(a) = 1 for all numbers a. 


lath) — f(a 


ae) = ind 
h-0 


h 
. ath—a 
= Im —————_ 
h-0O h 
h 
= lim — =}. 
Hae 


The derivative of the sum of two functions is just what one would hope— the 
sum of the derivatives. 


168 


THEOREM 3 


PROOF 


THEOREM 4 


PROOF 


THEOREM 5 


PROOF 


(f +2) (@ = Im 
h—0 


(f s g) (a) = fy, 
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If f and g are differentiable at a, then f + g is also differentiable at a, and 


(f+e)(a)= fia+e'(@. 


(f+evla+h)-(f+e8)(a) 


h 
Se fla+h) + e(a+h)—|[f(@) + gla) 
i h—O0 h 
pa — f(a) ee) 
= lim | AAA $s @ 
h-0 h h 
. flath)— fla) . glat+h) — g(a) 
= hm A. Fs Lams MA 
h>0 h h—>0 h 


= f(a)+g'(a).] 


The formula for the derivative of a product is not as simple as one might wish, 
but it is nevertheless pleasantly symmetric, and the proof requires only a simple 
algebraic trick, which we have found useful before—a number is not changed if 
the same quantity is added to and subtracted from it. 


If f and g are differentiable at a, then f - g is also differentiable at a, and 


(fg) (a) = f(a): gla) + fla) - g(a). 


(f -g)\(a+h) —(f -g)(a) 
h 


h 


fla+h)[ g(a +h) — g(a)] on [f(a +h) — f(a)|g(a) 
h h 
; aly in) = 
= lm f(a+h)- lim ACA ALS) + lm Cea sere) - lim g(a) 
h—0 h>0 h h—0 h h>0 


= f(a)-g9'(a)+ f(a): g(a). 


(Notice that we have used Theorem 9-1! to conclude that lim fla+h)= fla). J 
h0 
In one special case Theorem 4 simplifies considerably: 


If g(v) =cf(x) and f is differentiable at a, then g is differentiable at a, and 


g(a) =e- f (a). 


If h(x) =c, so that g =h- f, then by Theorem 4, 


g(a) =(h- f) (a) 
=h(a)- f'(a)+h'(a)- fla) 
=c- f'(a)+0- fla) 
=<c~* fata). | 
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THEOREM 6 


PROOF 


Notice, mn particular, that (— f)/(a) = — f(a), and consequently (f — g)/(a) = 
Cf tale lay =f (a2 (a). 

To demonstrate what we have already achieved, we will compute the derivative 
of some more special functions. 


If f(x) =x" for some natural number n, then 


I 


if (@Sta a for all a. 


The proof will be by induction on n. For n = I this is simply Theorem 2. Now 
assuniertiiat the theorem is truesor #7, so that ite f(x) = 2 «them 


I 


t (@ =a for all a. 


n+] ats 


Let e(x) =x"t!, If 1(x) = x, the equation x x” - x can be written 
8 | 


g(x) = FOOD eke) for all’x : 
thus g = f- TJ. It follows from Theorem 4 that 


eta) =(f - 1) Q=@) -Ma)+ f@- 1@) 
— ego oes ol 
= na" +a" 
= (7 elias for all a. 


This is precisely the case 2 + | which we wished to prove. 


Putting together the theorems proved so far we can now find f’ for f of the 
form 
ye aT) n—l wo : 
P= fig X + Oy ~1X +++ +anx” +ayx tao. 


We obtain 
= aa), 
t Garni, = 1a, 2 era ae 


We can also find f”: 


3 


f @) =n7G— Dare + Oa ten eo eae ee aa 


This process can be continued easily. Each differentiation reduces the highest 
power of x by 1, and eliminates one more aj. It is a good idea to work out the 
derivatives f’", f, and perhaps f©, until the pattern becomes quite clear. The 
last interesting derivative is 
f(x) = n!ay! 
for k > n we have 
fC) = 

Clearly, the next step in our program is to find the derivative of a quotient f/g. 
It is quite a bit simpler, and, because of ‘Theorem 4, obviously sufficient to find 
the derivative of I/g. 


THEOREM 7 


PROOF 


THEOREM 8 
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If g ts differentiable at a, and g(a) 4 0, then 1/g is differentiable at a, and 
1 \e —'(a) 
— | (a) = ——... 
(:) [g(a)|? 


Before we even write 


(~) (ath) — (~) (a) 
g . 


h 


we must be sure that this expression makes sense—it is necessary to check that 
(1/g)(a+h) is defined for sufficiently small 4. This requires only two observations. 
Since g is, by hypothesis, differentiable at a, it follows from ‘Theorem 9-1] that g is 
continuous at a. Since g(a) 4 0, it follows from ‘Theorem 6-3 that there ts some 
6 > Osuch that g(a +h) 4 0 for |h| < 6. Therefore (1/g)(a +h) does make sense 
for small enough /, and we can write 


l | | j 
wae) | ae reas 
lim AS/ ee lim slat) gta) 
h-0 h h>0 h 


8) = g(a eh) 


= hm SS 
h-0 h[g(a)- g(a +h)| 
. —-[g(at+h) —- g(a)] | 
—— ——— a, a 
h=0 h g(ajgla +h) 
Bile) ie Si Gellman | 
= hm AS: | ms A 
h>0 h h>0 g(a): g(a +h) 
2 =pign. =~ = 
; [g(a)]? 


(Notice that we have used continuity of g at a once again.) § 


The general formula for the derivative of a quotient is now casy to derive. 
Though not particularly appealing, it is important, and must simply be memo- 
rized (I always use the incantation: “bottom times derivative of top, minus top 
times derivative of bottom, over bottom squared.” ) 


If f and g are diflerentiable at a and g(a) 4 0, then f/g 1s differentiable at a, 
and 
(4) gta): f(a) — fla): ga) 

(a) = 


g [g(a)]? 
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PROOF Since f/g = f - (1/g) we have 
/ | / 
(4) (a) = (s : -| (a) 
§ § 
; l EY 
f (a): (= (a) + f(@)- (< (a) 
§ § 


LP @Pe LOE) 


g(a) [g(a)|? 
= f'(a)- g(a) — f(a): g'(a) F 
[g(a)]? 


We can now differentiate a few more functions. For example, 


x*—1 (x? + 1)(2x) — (x2 — 1)(2x) 4x 
if Fey | e a SES = i — % ° 
AC =r Tape ne (x2 + 1/2 @2 Say’ 
, x , (2? +41) — x(2x) 1 — x2 
f z = "5 | S IG ee 3 
Emma) 8 I) (x2 + 1)2 @2+ 12 

l | 
if Co then f(x) =-—s = (S)e=: 

% x* 


Notice that the last example can be generalized: if 


l 
f(x) =x" = —, — for some natural number n, 
x 


then 
I oN oe .—-n—l, 
Hix) = OF 4 = (—n)x : 


thus ‘Theorem 6 actually holds both for positive and negative integers. If we inter- 
pret f(x) =x° to mean f(x) = 1, and f’(x) = 0-x7! to mean f’(x) = 0, then 
Theorem 6 is true for n = 0 also. (The word “interpret” is necessary because it is 
not clear how 0° should be defined and, in any case, 0 - 07! is meaningless.) 
Further progress in differentiation requires the knowledge of the derivatives of 
certain special functions to be studied later. One of these is the sine function. For 
the moment we shall divulge, and use, the following information, without proof: 


Saas, 
sin (a) = cosa for all a, 
/ . ~ 
cos (a) = —sina for all a, 
This information allows us to differentiate many other functions. For example, if 
C3) ee SiN Se 
then 


if @)i=s cos x =sinw, 
f(x) = —x sin x + cosx + cosx 
= —xsinx +2cosx; 
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if 
, ) ; : 
2G) SsSiieey— Sin Versi x , 
then 
2%). =simix Gost cosa, sin® 
—_ eens X., 
g(x) = 2[(sin.x)(— sin x) + cos x cos x] 
co) ayaa | 
=, 2[Gassae— sit x |: 
if 
2D) 
BO) eS COR GC OSes 
then 


h'(x) = (cos x)(— sin x) + (— sin x) cos x 
= —2sIn x cos Xx, 
h" (x) = —2{cos? x — sin? x). 
Notice that 
g(x) +h’'(x) =90, 


hardly surprising, since (g + )(x) = sin? x + cos? x = 1. As we would expect, we 
also have g”(x) +h’ (x) = 0. 

‘Lhe examples above involved only products of two functions. A function involv- 
ing triple products can be handled by ‘Theorem 4 also; in fact it can be handled 
in two ways. Remember that f - g-/t is an abbreviation for 


( fa OIE OI A( Sa: 1). 
Choosing the first of these, for example, we have 


(f gh) (x) = (Ff 2) Gye? =e )Oadic (x) 
= [f'@)g@) + f(ix)g'@)JA@) + fF) g@)r'@) 
= fete is )eC i) + f a) Qan Cat 


The choice of f - (g +) would, of course, have given the same result, with a 
different intermediate step. ‘The final answer is completely symmetric and easily 
remembered: 


(f -g-h)’ is the sum of the three terms obtained by diflerentiating each of f, 
g, and ft and multiplying by the other two. 


For example, if 
CX) x? sim x cos x, 
then 
ol 3x7 sin x cosx +x? cosx cosx + x3(sin x)(— sin x). 
Products of more than 3 functions can be handled similarly. For example, you 
should have little difheulty deriving the formula 
(f-g-h- ky) = fg @)h@yk(x) + f@as'@h@kx) 
+ f(ryg(x)h'(x)k(x) + fxg (xyh(xyk'(x). 
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You might even try to prove (by induction) the general formula: 


n 
CDi ey er eve yoyo aney. 
=i 
Differentiating the most interesting functions obviously requires a formula for 
(f og)'(x) in terms of f’ and g’. To ensure that f og be differentiable at a, one 
reasonable hypothesis would seem to be that g be differentiable at a. Since the 
behavior of fo g near a depends on the behavior of f near g(a) (not near a), it 
also seems reasonable to assume that f 1s diflerentiable at g(a). Indeed we shall 
prove that if g is differentiable at a and f is differentiable at g(a), then f o g is 
differentiable at a, and 


(f Mea y (Gays (a), 


This extremely important formula is called the Cham Rule, presumable because 
a composition of functions might be called a “chain” of functions. Notice that 
(f og)’ is practically the product of f’ and g’, but not quite: f’ must be evaluated 
at g(a) and g’ at a. Before attempting to prove this theorem we will try a few 
applications. Suppose 


5 : 9 
Leek sine 
. ree 6 oS : ers 
Let us, temporarily, use S to denote the (“squaring”) function S(x) = x«°. ‘Phen 
7 = Silien. 
Therefore we have 
“pf 
fF Go) — sin (S(w)) 5 (x) 
2.9 
= comet: = er 
Quite a diflerent result is obtained if 
: ee) 
7 = sm 4 
In this case 
i= Sho sity 
sO 
f'(x) = S(sinx) - sin @) 
= 2 sit Veco, 


Notice that this agrees (as it should) with the result obtained by writmg f = sin: sin 
and using the product formula. 

Although we have invented a special symbol, $, to name the “squarimg”™ function, 
it does not take much practice to do problems like this without bothering to write 
down special symbols for functions, and without even bothering to write down the 
particular composition which f is—one soon becomes accustomed to taking f 
apart in one’s head. ‘Vhe following diflerentiations may be used as practice for 
such mental gymnastics if you find it necessary to work a few out on paper, by 
all means do so, but try to develop the knack of writing f’ immediately afier seemeg 
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the definition of f; problems of this sort are so simple that, if you just remember 
the Chain Rule, there is no thought necessary. 


i f(v) = sm x? then f’(x) = cosx? + 3x? 

f(x) = sin? x 1 Gos sin? x + cos x 

se). co il * l —] 
f(x) = sin — U1) oS 

x Ba ae 

F(X) = sin(sin wy) f GOe=scos(Siny) - GOS x 
1163 sin(x? + 3x7) je = cos(x? + 3x7) - (x? + 6x) 
(O= O° 23k” fi) 53H eG 6): 


A function hke 


aD y . 2432 
i) sings =s|eirmeu |e 
which is the composition of three functions, 
fH Sx sitro J, 


can also be differentiated by the Chain Rule. It is only necessary to remember 
that a triple composition f o goh means (f og)oh or f o(g oh). Thus if 


G2 3) 
Qs xs 
we can write 


jf = (8 osin) ce 
= So (ino 5). 


The derivative of either expression can be found by applying the Chain Rule 
twice; the only doubtful point is whether the two expressions lead to equally simple 
calculations. As a matter of fact, as any experienced differentiator knows, it is much 
better to use the second: 


J = 56 (sin os) 


We can now write down f’(x) im one fell swoop. ‘To begin with, note that the first 
function to be differentiated is S, so the formula for f’(+) begins 


f(y=2C ) 


. . D x . 
Inside the parentheses we must put sin.xv~, the value at x of the second function, 
smo S. Thus we begin by writing 


a . 9 
Jit eae SI 


(the parentheses weren't really necessary, after all). We must now multiply this 
much of the answer by the derivative of sino S at x; this part is easy--it involves a 
composition of two functions, which we already know how to handle. We obtain, 
for the final auswer, 


= . 9 9 
fT @&) = 2st 6 ¢ Ges fay: 
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The following example is handled similarly. Suppose 


Po r= sits x7). 


Without even bothering to write down f as a composition gohok of three functions, 
we can see that the left-most one will be sin, so our expression for f’(x) begins 


t Coens ) 
. Cet . . 9) 
Inside the parentheses we must put the value of ho k(x); this is simply sin.x~ (what 
: . ‘ 9. : x , ~ . : 5 
you get from sin(sin.x~) by deleting the first sin). So our expression for f’(*) begins 
n . 9 
i G® =1ces(sinx) 
> = oe 5 C a) : 
We can now forget about the first sin in sin(sin.x~); we have to multiply what we 
. . . . . 9) . . 
have so far by the derivative of the function whose value at x is sin.x7— which is 
again a problem we already know how to solve: 


5 ° a ey 
f G@) = cos(sin x 9 Cis hoa. 


Finally, here are the derivatives of some other functions which are the composition 
of sm and S$, as well as some other triple compositions. You can probably just 
“see” that the answers are correct— if not, try writing out f as a composition: 


if fG) —Seind(sin x)’) then f’(x) = cos((sin x)*) -2sin.x - cos x 
7) =]ismGin mye f («) = 2sin(Snrx)” cos(Gimix cag: 
f(x) Ssim(sin(sin x)) f' (x) = cos(sin(sin.x)) + cos(sin x) - cos x 
i) sin? (x sin x) f. @) = 2sin(«% sin x) - ‘cos(x six) 


- [sin x -+.x ¢0s x | 
. . > -. af . » . 2 . 
6 ]SiaGnile sinx4) i Ge) =Jie0s(sin (x “siirt)) cos ~ sige) 
. 9 
: (2 sin x = ae cos X]- 
The rule for treatng compositions of four (or even more) functions 1s easy— 
always (mentally) put in parentheses starting from the right, 


fo(geo(hok)), 


and start reducing the calculation to the derivative of a composition of a smaller 
number of functions: 


f(g (A(k(x)))) 
For example, if 


f(x) = sin?(sin?(x)) Lf = Sosm aS 8isin 
= §o (sins ($s sin))| 


then 


Mi hy . oo eD 4). 
f (@&) = 23rfiGin’ ws) « Gos(siw) - Ssinw - GOS wt 
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if 
7) sin (isin x7)?) | f'=sint S clsmeeS 
= sino (§ o (sino $))] 
then 
A) = Cosi x7)*) -2sinx* - cosx? - 2x: 
if 
f (x) = sin?(sin(sin.x)) [fill in yourself, if necessary | 
then 


f(x) = 2sin(sin(sin x)) « cos(sin(sin.x)) - cos(sin x)» cos.x. 


With these examples as reference, you require only one thing to become a master 
diflerentiator—practice. You can be safely turned loose on the exercises at the end 
of the chapter, and it is now high time that we proved the Chain Rule. 

The following argument, while not a proof, indicates some of the tricks one 
might try, as well as some of the difficulues encountered. We begin, of course, 
with the definition— 


Ong h) — Og 
(f fo) 2)'(a) _ hm Coe aaiga) foe te) 


1—>0 h 

. f(gla+h)) — f(g(a)) 
— hm SS 

h->0 h 


Somewhere in here we would like the expression for g’(a). One approach is to 
put it in by fat: 


big SRO) S PCY ctees, ll EM tS ola or) = 8a) 
h—0 h ~ho0 = gla +h) — g(a) h 


This does not look bad, and it looks even better if we write 


r 
ay h 
. f(gla)+ [gla +h) -— g(a)|)-— fl(g@) ,. glat+h)—- g(a) 
= ko £m A> —, 
h—0 g(a +h) — g(a) h—0 h 


The second limit is the factor g’(a) which we want. If we let g(a +h) — g(a) =k 
(to be precise we should write k(/7)), then the first limit is 


eet k) — f(e(a)) 
kn, 
h—0 kK 


It looks as if this hmit should be f’(g(a)), since continuity of g at a mphies that k 
goes to 0 as ht does. In fact, one can, and we soon will, make this sort of reasoning 
precise. ‘There is already a problem, however, which you will have noticed if you 
are the kind of person who does not divide blindly. Even for h 4 0 we might have 
g(a +h) — g(a) = 0, making the division and multiplication by g(a +h) — g(a) 
meaningless. ‘True, we only care about small #, but g(a + 4) — g(a) could be 0 
for arbitrarily small h. ‘Vhe easiest way this can happen is for g to be a constant 


178 Derivatives and Integrals 


THEOREM 9 (THE CHAIN RULE) 


PROOF 


functions g(x) = c@Then g(@ -+ &) —%e(@)t0 for all &. In this case, f & 2 is also 
a constant function, (f o g)(x) = f(c), so the Chain Rule does indeed hold: 


Cf 08) @)—0= fm Bia))ee (a). 
However, there are also nonconstant functions g for which g(a + /1) — g(a) = O 


for arbitrarily small i. For example, if a = 0, the function g might be 


Ls 


I 

SIN =, ak oe 
x 

0, ea) 


g(x) = 


In this case, g’(O) = 0, as we showed in Chapter 9. Ifthe Chain Rule is correct, we 
must have (fo g)’(O) = 0 for any diflerentiable f, and this is not exactly obvious. 
A proof of the Chain Rule can be found by considering such recalcitrant functions 
separately, but it is easier simply to abandon this approach, and use a trick. 


If g is differentiable at a, and /f is differentiable at g(a), then fog is differentiable 
aha, and 


(fog) (a) = f'(gla))- g(a). 


Define a function ¢ as follows: 
f(g(a +h)) — f(g(a)) 
ONG glath)—g(a) — 
f'(g(a)), if g(a +h) — g(a) =0. 


It should be intuitively clear that @ is continuous at 0: When /: is small, 


Ee CS te ie 9) a0 


g(a +h) — g(a) is also small, so if g(a +h) — g(a) is not zero, then @(/) will 
be close to f’(g(a)); and if it is zero, then @(/) actually equals f’(g(a)), which 
is even better. Since the continuity of @ is the crux of the whole proof we will 
provide a careful translation of this intuitive argument. 
We know that f is differentiable at g(a). This means that 

. £(gla)+k)— f(gta)) ; 

lim. —-————_—_—_>-—. = f'(g(a)). 

k—0 k 
Thus, if ¢ > 0 there is some number 6’ > 0 such that, for all k, 


k 


Now g is differentiable at a, hence continuous at a, so there is a 6 > O such that, 
for all h, 


(1) if O < {k| < 86’, then — f'(g(a))| <. 


(2) if {h| <8, then |g(a +h) — g(a)| < 8. 


Consider now any ft with |h| < 6. If k = g(a +h) — g(a) £0, then 


TeG@+h)— (—@@) fe@qQiwast(s@). 
g(a +h) — gla) - k 


it follows from (2) that |A| < 6’, and hence from (1) that 


Ip(h) — f'(g(a))| < e. 


ON = 
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On the other hand, if g(a + h) — g(a) = 0, then @(h) = f’(g(a)), so it is surely 
true that 


lp(h) — f'(g(a))| < e. 


We have therefore proved that 
lim $(h) = (2@)), 


so @ is continuous at 0. The rest of the proof is easy. If h 4 0, then we have 


f(g(a + = — f(g(a)) aie g(a ss — g(a) 


even if g(a +h) — g(a) = 0 (because in that case both sides are 0). ‘Therefore 
h 
= f'(g(a))- g'(a). J 


g(a +h) — g(a) 


[e) i — hi 
(Fog) @) iO h 


ali h)- it 
Ow) xO 


Now that we can differentiate so many functions so easily we can take another 
look at the function 


l 
Dies 
csr —, 610 
K 


0, a— 0) 


fx)= 


In Chapter 9 we showed that f’(0) = 0, working straight from the definition (the 
only possible way). For x #4 0 we can use the methods of this chapter. We have 


“/ 1 5 ] 1 
f'(x) = 2x sin — + x*cos—-(-— ); 
Xx 36, Xe 
Thus 
52 vill 1 
2xsm——cos—, x40 
Xx 56 


0, a 0)8 


f(x) = 


As this formula reveals, the first derivative f’ is indeed badly behaved at 0—1t is 
not even continuous there. If we consider instead 


then 
BaD l aaa: 40 
Pix) 3x SHS x CO Xx 
sp = (0) 


= 


In this case f’ 1s continuous at 0, but f”(0) does not exist (because the expres- 
+ Daas ~ ~ . . . “YT . . 
sion 3x“ sin 1/x defines a function which is differentiable at 0 but the expression 
—x cos 1/x does not). 
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As you may suspect, increasing the power of x yet again produces another 
improvement. If 


l 
oe 
ae x* sin a x Fi 


then 


a, > l 
Axdcine x cos a0 


gol x Xx 
0, an 


It is easy to compute, right from the definition, that (f’)'(0) = 0, and f”(x) is 
easy to find for x 4 0: 
| l I 4 
ope [2yesin 4 cos = = 2 Ges = i ee 
fX)= PS x OS 5G 


0, Koa 


In this case, the second derivative f” 1s not continuous at 0. By now you may have 
guessed the pattern, which two of the problems ask you to establish: if 


Sit. ee 0 
0, ie 0. 


then f’(0), ... , f(O) exist, but f™ is not continuous at 0; if 


l 
Zp) . 
oo ee 


f@) = ss x 
0, a. 


then f’(0),..., f%(O) exist, and f“” is continuous at 0, but f is not differ- 
entiable at 0. ‘These examples may suggest that “reasonable” functions can be 
characterized by the possession of higher-order derivatives—no matter how hard 
we try to mask the mfinite oscillation of f(x) = sin |/x, a derivative of sufficiently 
high order seems able to reveal the underlying irregularity. Unfortunately, we will 
see later that much worse things can happen. 

After all these mvolved calculations, we will brmg this chapter to a close with 
a minor remark. It is often tempting, and seems more elegant, to write some of 
the theorems in this chapter as equations about functions, rather than about their 
values. Thus Theorem 3 might be written 


Cf pe)! See 
Theorem 4 might be written as 
MPA Bs ae oe 
and ‘Theorem 9 often appears m the form 


Gf og) — (Uf eg) g- 
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Strictly speaking, these equations may be false, because the functions on the left- 


hand side might have a larger domain than those on the right. Nevertheless, this 


is hardly worth worrying about. If f and g are differentiable everywhere im their 


domains, then these equations, and others like them, ave true, and this 1s the only 


case any one cares about. 


PROBLEMS 


I. 


As a warm up exercise, find f(x) for each of the following f. (Don’t worry 
about the domain of f or f”; just get a formula for f’(x) that gives the right 
answer when it makes sense.) 


(i) f(x) =sin(w +x). 
(ii) f(x) =sinx + sin x?. 
(in) f(x) =sin(cos.x). 
(iv) /() = sni(sinay 

5 / GO5a, 
(ve (ae) sin ( * } 
sin(cos x) 


il) 


(vi) f@)= 
(vn) 


(viii) 


ne 
f(x) = sin(x + sin). 
7) =sm(Cos(sin we 


Find f’(x) for each of the followmeg functions f. (It took the author 20 min- 
utes to compute the derivatives for the answer section, and it should not take 
you much longer. Although rapid calculation is not the goal of mathematics, 
if you hope to treat theoretical apphcations of the Chain Rule with aplomb, 
these concrete applications should be child’s play—mathematicians like to 
pretend that they can’t even add, but most of them can when they have to.) 


(i) f(x) =sin((x + 1)? +2). 
i fa) = sin? (x2 + sin.x). 
Gil) f(x) = sin?((x + sinx)?). 


° 

Gy) fG@)=sin = 

cos x° 
(v) f(x) = sin(x sin.x) + sin(sin x7), 
(ee x) (cosx 3h’, 
Qi) — sin? x sin x2 sin? x2. 
(vi) f(x) = sin (sin (sin Xs 
xe Oia sin? x)°, 
(x) f(x) = sin(sin(sin(sin(sin.v)))). 
(xi) f(x) = sin((sin’ x? + 1)”). 
(xii) f(x) = (G7 +a +4)t +x). 
(Sean) fx i sin(x2 + sin(x2 + sin x7)). 
(xiv) f(x) = sin(6 cos(6sin(6 cos 64 ))). 
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: eu, 
smx~ sm X 


(xv) f(x) = 


1 + sinx 
UPAs l 
XV1 G).— 
avi) f(x) ; 
x 4+sinx 
x 
vanes) sin} . ( ee 
sin | — 
sin x 
Ds 
(xvi) f(x) = sin me ( a ) 
x — sinx 


Find the derivatives of the functions tan, cotan, sec, cosec. (You don’t have 
to memorize these formulas, although they will be needed once in a while; if 
you express your answers in the right way, they will be simple and somewhat 
symmetrical.) 


For each of the following functions f, find f’(f(x)) (not (f o f)'(x)). 


Ud 9) Sacer 


(i Ga sin x. 
Gi f@)Sx2: 
vj Ca l7:. 


For each of the following functions f, find f(f’(x)). 


ee Co 


(ii) f(x) =x. 
(a) “eo 7: 
(Gv) Gai iec. 


. 


=| 


Find f’ in terms of g’ if 


() Coen ea): 
il), Sf Ces Gis eG)). 
ii) f(x) =g(%4+g(x)). 
IV). fo) — eC) Ga a). 
Vv). J@=2@OG— a): 
vi) f(x +3) = g(x’). 


a) A circular object is increasing in size in some unspecified manner, but it 
is known that when the radius is 6, the rate of change of the radius is 4. 
Find the rate of change of the area when the radius 1s 6. (If r(t) and A(t) 
represent the radius and the area at time f, then the functions r and A 
satisfy A = mr; a straightforward use of the Chain Rule is called for.) 


10. 


11. 


¥2. 


13. 
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(b) Suppose that we are now informed that the circular object we have been 
watching is really the cross section of a spherical object. Find the rate 
of change of the volwne when the radius is 6. (You will clearly need to 
know a formula for the volume of a sphere; m case you have forgotten, 
the volume is +70 times the cube of the radius.) 

(c) Now suppose that the rate of change of the area of the circular cross 
section is 5 when the radius is 3. Find the rate of change of the volume 
when the radius is 3. You should be able to do this problem in two 
ways: first, by using the formulas for the area and volume in terms of 
the radius: and then by expressing the volume in terms of the area (to 
use this method you will need Problem 9-3). 


The area between two varying concentric circles is at all times 97 in*. The 
rate of change of the area of the larger circle is 10m in?/sec. How fast is the 
circumference of the smaller circle changing when it has area 167 in? 

Particle A moves along the positive horizontal axis, anc particle B along the 
graph of f(x) = ~J/3x,x <0. Ata certain time, A is at the point (5,0) 
and moving with speed 3 units/sec; and B is at a distance of 3 units from 


the ongin and moving with speed 4 units/sec. At what rate is the distance 
between A and B changing? 


Let f(x) =x? sin 1/x for x 4 0, and let f(0) = 0. Suppose also that /: and k 
are two functions such that 
h'(x) = sin7(sin(x + 1) k(x) = f(x+1) 
“(Oe k(Q) =0: 
Find 
(i) (foh)'(0). 
(u) (ko f)’(O). 
(iii) o’(x7), where a(x) = h(x’). Exercise great care. 
Find f’(O) if 
I 
g(x)sn-, x40 
& 
0. ao — 0h 


A= 


and 


eo) = (0) 0: 


Using the derivative of f(x) = I/x, as found m Problem 9-1, find (1/g)’(x) 
by the Chain Rule. 


(a) Using Problem 9-3, find f’(x) for —] <x < 1,if f(x) = V1 — x2. 
(b) Prove that the tangent line to the graph of f at (a. v1 — a2) intersects 


the graph only at that pomt (and thus show that the elementary geometry 
definition of the tangent line comeides with ours). 
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Prove similarly that the tangent lines to an ellipse or hyperbola intersect these 
sets only once. 


If f +g is differentiable at a, are f and g necessarily differentiable at a? 
If f-g and f are differentiable at a, what conditions on f imply that g is 
diflerentiable at a? 


(a) Prove that if f is differentiable at a, then |f| is also differentiable at a, 
provided that f(a) € 0. 

(b) Give a counterexample if f(a) = 0. 

(c) Prove that if f and g are differentiable at a, then the functions 
max(f, g) and min(f, g) are differentiable at a, provided that f(a) 4 
g(a). 

(d) Give a counterexample if f(a) = g(a). 


Give an example of functions f and g such that g takes on all values, and fog 
and g are differentiable, but f isn’t differentiable. (The problem becomes 
trivial if we don't require that g takes on all values; g could just be a constant 
function, or a function that only takes on values in some interval (a,b), in 
which case the behavior of f outside of (a,b) would be irrelevant.) 


(a) If g = f? find a formula for g’ (involving f’). 

(b) If g = (f’)’, find a formula for g’ (involving f”). 

(c) Suppose that the function f > 0 has the property that 
l 

Fal 


Find a formula for f” m terms of f. (In addition to simple calculations, 


fyr=aft 


a bit of care is needed at one point.) 


If f is three times differentiable and f’(x) 4 0, the Schwarzian derwative of f 
at x is deimed to be 


(a) Show that 
Bf og) = (Df og)-g’* + Be. 


v+l 
(b) Show that if f(x) = oer with ad — bc # 0, then Df = 0. Conse- 
CX + ¢ 


quently, @( fog) = Mg. 


Suppose that f(a) and g’? (a) exist. Prove Leibniz’s formula: 


i 


Gf P gy (a) = ») ({) ray ; ea). 


k=0 


A 
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Prove that if f(g(a)) and g(a) both exist, then (f o g) (a) exists. A 
little experimentation should convince you that it is unwise to seek a formula 
for (f og)" (a). In order to prove that (f og) (a) exists you will therefore 
have to devise a reasonable assertion about (f 0g) (a) which can be proved 
by induction. Try something like: “(f o g)(a) exists and is a sum of terms 
each of which is a product of terms of the form... .” 


(a) If f(x) = ayx" +a,_1x""! +--+ ap, find a function g such that g’ = f. 
Find another. 
(b) If 
ee my Se 
i ax Xx 
find a function g with g’ = f. 
(c) Is there a function 


b 
A) 0, ele 
suchethat 7 Goyal xe 
Show that there is a polynomial function f of degree n such that 


(al () 0 tor precisely, numbers x. 

(b) fi) = itor no x3 if is odd. 

(c) f'(x) = 0 for exactly one x, if m is even. 

(d) f’(x) =0 for exactly k numbers «x, if n — k is odd. 
( 


a) The number a is called a double root of the polynomial function f if 
f(x) = (x — a)*g(x) for some polynomial function g. Prove that a is a 
double root of f if and only if a is a root of both f and f’. 

(b) When does f(x) = ax? + bx +c (a ¥ 0) have a double root? What does 
the condition say geometrically? 


If f is differentiable at a, let d(x) = f(x) — f’(a)(x —a) — f(a). Find d’{a). 


In connection with Problem 24, this gives another solution for Problem 9-20. 


This problem is a companion to Problem 3-6. Let aj,..., Geangepin ee co} 
be given numbers. 


(a) If xj,..., 2x» are distinct numbers, prove that there is a polynomial func- 
von 7 ofdesres 2n —7l, such that fre jf G) = Ofory -~ @ and 
f (xj) =a; and f’(x;) = b;. Hint: Remember Problem 24. 

(b) Prove that there is a polynomial function f of degree 2n —1 with f(x) = 
a; and f'(x;) = 5; for all i. 


Suppose that a and b are two consecutive roots of a polynomial function f, 
but that a and b are not double roots, so that we can write f(x) = 


(x — a)(x — b)g(x) where g(a) 4 0 and g(b) £ 0. 


(a) Prove that g(a) and g(b) have the same sign. (Remember that a and b 
are consecutive roots.) 
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(b) Prove that there is some number x with a < x < b and f’(x) =0. (Also 
draw a picture to illustrate this fact.) Hint: Compare the sign of f’(a) 
and f’(b). 

(c) Now prove the same fact, even if @ and b are multiple roots. Hint: If 
f(x) = «— a)" (x — b)" g(x) where g(a) 4 0 and g(b) ¥ 0, consider the 
polynomial function A(x) = f"(x)/(@ — PS ee a als 


This theorem was proved by the French mathematician Rolle, in connection 
with the problem of approximating roots of polynomials, but the result was 
not originally stated in terms of derivatives. In fact, Rolle was one of the 
mathematicians who never accepted the new notions of calculus. ‘This was 
not such a pigheaded attitude, in view of the fact that for one hundred years 
no one could define limits in terms that did not verge on the mystic, but on 
the whole history has been particularly kind to Rolle; his name has become 
attached to a much more general result, to appear m the next chapter, which 
forms the basis for the most important theoretical results of calculus. 


Suppose that f(*) = xg(x) for some function g which is continuous at 0. 
Prove that f is differentiable at 0, and find f’(O) in terms of g. 


Suppose f is differentiable at 0, and that f(O) = 0. Prove that f(x) = xg(x) 
for some function g which is continuous at 0. Hint: What happens if you try 
to write g(x) = Fox? 

If f(x) =x for n in. N, prove that 


“5 Se) ae eS k 
(it el)! 


= (-] we ms = Vet. for AU) 


£ OC y= 


Prove that it 1s impossible to write x = f(*)g(x) where f and g are differ- 
entiable and f (0) = g(0) = 0. Hint: Differentiate. 


What is f(x) if 


(a) f(x) =1/@ —a)"? 
7b) fy =a oe L)> 


Let f(x) = x?"sin I/x if x 4 0, and let f(0) = Prowegunadtiy (O)eee en 
f'™(O) exist, and that f’ is not continuous at - a will encounter ihe 
same basic difficulty as that in Problem 21.) 


het f(x) = x*"+" sin I/x if x 4 0, and let ((0) = 0. Provethar f’(0),.... 
f'(O) exist, that f is continuous at 0, and that f” is not differentiable 


at Q. 


35. 
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In Leibnizian notation the Chain Rule ought to read: 


df(g(x)) _ df(y) dg (x) 
dx dy Nea), ax 
Instead, one usually finds the following statement: “Let y = g(x) and 
ZG) eae eae a 


dx dy dx’ 


Notice that the z in dz/dx denotes the composite function f og, while the z 
in dz/dy denotes the function f; it is also understood that dz/dy will be “an 
expression involving y,” and that in the final answer g(x) must be substituted 
for y. In each of the following cases, find dz/dx by using this formula; then 
compare with Problem 1. 

(i) z=siny, y=x4+x?. 

(1) << =isinays, y= cos. 

(OVD ie AS Fo n/n 

(iv) AZ sino nw Cosme, sa sin x: 
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SIGNIFICANCE OF THE DERIVATIVE 


One aim in this chapter is to justify the tme we have spent learning to find the 
derivative of a function. As we shall see, knowing just a little about f’ tells us a 
lot about f. Extracting information about f from mformation about f’ requires 
some difficult work, however, and we shall begin with the one theorem which is 
really easy. 

‘This theorem is concerned with the maximum value ofa function on an interval. 
Although we have used this term informally in Chapter 7, it is worthwhile to be 
precise, and also more general. 


Let f be a function and A a set of numbers contained in the domain of f. 
A point x in A is a maximum point for f on A if 


f() = f(y) for every y in A. 


The number f(x) itself is called the maximum value of f on A (and we also 
say that f “has its maximum value on A at x”). 


Notice that the maximum value of f on A could be f(x) for several different x 
(Figure 1); in other words, a function f can have several different maximum points 
on A, although it can have at most one maximum value. Usually we shall be 
interested in the case where A is a closed interval [a, b|; if f is continuous, then 
Theorem 7-3 guarantees that f does indeed have a maximum value on [a, }]. 

The definition of a minimum of f on A will be left to you. (One possible 
definition is the following: f has a minimum on A at x, if —f has a maximum 
on A at x.) 

We are now ready for a theorem which does not even depend upon the existence 
of least upper bounds. 


Let f be any function defined on (a, b). If x is a maximum (or a minmum) pomt 
for f on (@, PP andy is differentiable at x, them, @) = 0. 

(Notice that we do not assume differentiability, or even continuity, of f at other 
pots.) 


Consider the case where f has a maximum at x. Figure 2 illustrates the simple idea 
behind the whole argument—-secants drawn through points to the left of (x, f(x) 
have slopes > 0, and secants drawn through points to the right of (x, f(v)) have 
slopes < 0. Analytically, this argument proceeds as follows. 
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If A is any number such that x +/ is in (a,b), then 
ia) = [tc 4 ht), 
since f has a maximum on (a, b) at x. Vhis means that 
i a) — 7 (x) = 0. 


Thus, if 4 > 0 we have 
F(x +h) — f(x) Ee 


; 0. 


and consequently 
ee ia) J) 
lim ———————-—- < 


(0. 
h—O0+ h 


On the other hand, if A < 0, we have 


F(x+th)—- f@) Le 
h E 
sO 
lim peas) = bi) ble) = 


(0). 
h>0- h 


By hypothesis, f is differentiable at x, so these two limits must be equal, in fact 
equal to f’(x). This means that 


Vion and f(x) > 0, 


from which it follows that f’(x) = 0. 
The case where f has a minimum at x is left to you (give a one-line proof). § 


Notice (Figure 3) that we cannot replace (a, b) by [a, b| in the statement of the 
theorem (unless we add to the hypothesis the condition that x is in (a, b).) 

Since f’(x+) depends only on the values of f near x, it is almost obvious how to 
get a stronger version of Theorem 1. We begin with a definition which is illustrated 
in Figure 4. 


Let f be a function, and A a set of numbers contained in the domain of f. 
A point x in A is a local maximum [minimum] point for f on A if 


there is some 6 > O such that x is a maximum [minimum] point for f on 
AN (x —6.x +5). 


If x is a local maximum or minimum for f on (a,b) and f is differentiable at x. 


then tf xe) = 0) 


You should see why this is an easy application of Theorem |. J 
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The converse of Theorem 2 is definitely not rue —it is possible for f’(x) to be 0 
even if x is not a local maximum or minimum point for f. The simplest example 
is provided by the function f(x) = x+; in this case f’(0) = 0, but f has no local 
maximum or minimum anywhere. 

Probably the most widespread misconceptions about calculus are concerned 
with the behavior of a function f near x when f’(x) = 0. The point made in 
the previous paragraph is so quickly forgotten by those who want the world to be 


the 
condition f’(x) = 0 docs not imply that x 1s a local maximum or minimum point 


simpler than it is, that we will repeat it: the converse of Theorem 2 is not true 


of f. Precisely for ths reason, special terminology has been adopted to describe 
numbers x which satisfy the condition f’(x) = 0. 


A critical point of a function f is a number x such that 


VC) SU. 


The number f(x) itself is called a critical value of ff. 


The critical values of f, together with a few other numbers, turn out to be the 
ones which must be considered in order to find the maximum and minimum of a 
given function f. To the unmitiated, finding the maximum and minimum value 
of a function represents one of the most intriguing aspects of calculus, and there 
is no denying that problems of this sort are fun (unul you have done your first 
hundred or so). 

Let us consider first the problem of finding the maximum or minimum of f 
on a closed interval [a,b]. (Then, if f is continuous, we can at least be sure 
that a maximum and minimum value exist.) In order to locate the maximum and 
muumum of f three kinds of points must be considered: 


(1) The critical pomts of f m [a, 5]. 
(2) The end pomts a and b. 
(3) Pomts x m [a,b] such that f is not differentiable at x. 


If x is amaximum point or a minimum point for f on [a, b], then. must be in one 
of the three classes hsted above: for if x is not in the second or third group, then 
x is in (a,b) and f is differentiable at +; consequently f’(.) = 0, by Theorem 1, 
and this means that x ts m the first group. 

If there are many pomts in these three categories, finding the maxumum and 
minimum of f may still be a hopeless proposition, but when there ave only a few 
eritical points, and only a few points where f is not diflerentiable, the procedure ts 
fairly straightforward: one simply finds f(x) for each x satisfying f(x) = 0, and 
f(x) for each x such that f is not differentiable at x and, finally, f(a) and f(b). 
The biggest of these will be the maximum vahie of f, and the smallest will be the 
minimum. A simple example follows. 
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Suppose we wish to find the maxnmum and minimum value of the function 
CS) 
on the interval [—1, 2]. To begin with, we have 
f'(x) = 3x? - 1, 
50../ XJ Uaviem 3x2 — 1 = 0, that is, when 
Savio or —4/ 1/3. 
The numbers /1/3 and =. eo both he in [—1. 2], so the first group of candidates 


for the location of the maximum and the minimum is 


a 73, 18. 


The second group contains the end pots of the interval, 
Cre ol, 2. 


The third group is empty, since f is differentiable everywhere. ‘The final step 1s to 
compute 


F(/1/3). =W/IBY = 173 = 3173 — V1/3 = - 31/3, 
f(-V1/3) = (-J1/399 - (- 1/3) = -4,/1/3 + J1/3 = 37/3. 


f(-1) =0, 
f(2) =6. 


Clearly the mmmnum value ts =5/ 1/3, occurring at / 1/3, and the maximum 
value is 6, occurring at 2. 

This sort of procedure, if feasible, will always locate the maximum and minnmum 
value of a continuous function on a closed interval. If the function we are dealing 
with is not continuous, however, or if we are seeking the maximum or Miumum 
on an open interval or the whole line, then we cannot even be sure beforehand 
that the maximum and mmimum values exist, so all the mformation obtained by 
this procedure may say nothing. Nevertheless, a little ingenuity will often reveal 
the nature of things. In Chapter 7 we solved just such a problem when we showed 
that if #7 1s even, then the function 


f(x) =x" +ay_jx" +--+ + a9 


has a miminum value on the whole line. ‘This proves that the minimum value must 
occur at some number x satisfying 
i a ea) 
0S Air lm — Dax? + 


If we can solve this equation, and compare the values of f(x) for such x, we can 
actually find the mmimum of f. One more example may be helpful. Suppose we 
wish to find the maximum and minimum, if they exist, of the function 

fQ@)= 


a 
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on the open interval (—1, 1). We have 


x 


: ph 
OS 

Clim eis 

so f’(x) = O only for x = 0. We can see immediately that for x close to | or —1 the 
values of f(x) become arbitrarily large, so f certainly does not have a maximum. 
This observation also makes it easy to show that f has a mmimum at 0. We just 
note (Figure 5) that there will be numbers a and 5, with 


=FPaam=<0 and O<b<14, 
such that f(x) > f(O) for 
—l-we<q and b<x = |. 


This means that the mmimum of f on [a,b] is the mmimum of f on all of 
(—1,1). Now on [a,b] the minimum occurs either at 0 (the only place where 
f’ = 0), or at a or b, and a and b have already been ruled out, so the minimum 
valucais f(O) = 1. 

In solving these problems we purposely did not draw the graphs of f(r) = x3 —x 
and f(x) = 1/(1 — x7), but it is not cheating to draw the graph (Figure 6) as long 
as you do not rely solely on your picture to prove anything. ‘As a matter of fact, we 
are now going to discuss a method of sketching the graph ofa function that really 
gives enough information to be used in discussmg maxima and minima—in fact 
we will be able to locate even /ocal maxuna and minima. This method involves 
consideration of the sign of f’(x), and relies on some deep theorems. 

The theorems about derivatives which have been proved so far, always yield 
information about f’ in terms of mformation about f. This is true even of Theo- 
rem |, although this theorem can sometimes be used to determme certain informa- 
tion about f, namely, the location of maxima and minima. When the derivative 
was first introduced, we emphasized that f’(x) is not [f(x +h) — f(x)]/h for any 
particular h, but only a limit of these numbers as ft approaches 0; this fact becomes 
painfully relevant when one tries to extract information about f from information 
about f’. The smplest and most frustrating illustration of the difficulties encoun- 
tered is afforded by the followmeg question: If f’(x) = O for all x, must f be a 
constant function? It 1s impossible to imagine how f could be anything else, and 
this conviction is strengthened by considering the physical interpretation — if the 
velocity of a particle is always 0, surely the particle must be standing still! Never- 
theless it is dificult even to begin a proof that only the constant functions satisfy 
f'(x) = 0 for all x. The hypothesis f’(x) = 0 only means that 


. f(ix«th— f@) 
i —— 
h-0 h 


0. 


anc it is not at all obvious how one can use the information about the hmiit to 
derive information about the function. 
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The fact that f is a constant function if f’(x) = 0 for all x, and many other facts 
of the same sort, can all be derived from a fundamental theorem, called the Mean 
Value Theorem, which states much stronger results. Figure 7 makes it plausible 
that if f is differentiable on [a,b], then there 1s some x im (a,b) such that 


f(b) -— f(a) 


b—a 


fa)= 


Geometrically this means that some tangent line is parallel to the line between 
(a, f(a)) and (b, f(b)). The Mean Value Theorem asserts that this is trtue—there 
is some x m (a,b) such that f’(x), the instantaneous rate of change of f at x, 1s 
exactly equal to the average or “mean” change of f on [a, b], this average change 
being [ f(b) — f(a@)|/[b — a]. (kor example, if you travel 60 miles in one hour, 
then at some time you must have been traveling exactly 60 miles per hour.) ‘This 
theorem is one of the most important theoretical tools of calculus—probably the 
deepest result about derivatives. From this statement you might conclude that the 
proof is difficult, but there you would be wrong-- the hard theorems in this book 
have occurred long ago, in Chapter 7. It is true that if you try to prove the Mean 
Value ‘Theorem yourself you will probably fail, but this is neither evidence that the 
theorem 1s hard, nor something to be ashamed of. The first proof of the theorem 
was an achievement, but today we can supply a proof which is quite simple. It 
helps to begin with a very special case. 


If f is continuous on [a,b] and differentiable on (a,b), and f(a) = f(b), then 
theres a timer © im (ae>) such that (x) = 0: 


If follows from the continuity of f on [a,b] that f has a maximum anda minimum 
value on [a, b]. 

Suppose first that the maximum value occurs at a pomt x m (a,b). Then 
f'(x) = 0 by Theorem 1, and we are done (Figure 8). 

Suppose next that the minimum value of f occurs at some point + in (a,b). 
Then, again, f’(x) = 0 by Theorem 1 (Figure 9). 

Finally, suppose the maximum and mimimum values both occur at the end 
pots. Since f(a) = f(b), the maximum and minimum values of f are equal, 
so f is a constant function (Figure 10), and for a constant function we can choose 
any x in (a,b). ff 


Notice that we really needed the hypothesis that f 1s differentiable everywhere 
on (a,b) m order to apply Theorem 1. Without this assumption the theorem is 
false (Figure 11). 

You may wonder why a special name should be attached to a theorem as easily 
proved as Rolle’s Theorem. The reason is, that although Rolle’s ‘Theorem is a 
special case of the Mean Value ‘Vheorem, it also yields a simple proof of the Mean 
Value Theorem. In order to prove the Mean Value Theorem we will apply Rolle’s 
Theorem to the function which gives the length of the vertical segment shown m 
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Figure 12; this is the difference between f(x), and the height at x of the line L 
between (a, f(a)) and (b, f(b)). Since L is the graph of 


g(x) = eee eee 


(a) 7 (a); 


+ ! ba 
a b 
we want to look at 
BIGURE 11 . 
Be 
{QZ a] (ea) if (a): 
=A 


As it turns out, the constant f(a) is irrelevant. 


THEOREM 4 (THE MEAN VALUE If f is contmnuous on [a,b] and differentiable on (a, b), then there is a number x 
THEOREM) in (a, b) such that 
f(b) — fla) 


b—a 


f@= 


PROOF Let 


h(x) = f(x) — oe (x —a). 


b-—a 


Clearly, 4 is continuous on [a,b] and differentiable on (a, b), and 


h(a) — F(a), 


(b) — f(a) 
(b, f(b)) iby Se) (byes earned (x —a) 
bea 
L = f(a). 
Consequently, we may apply Rolle’s Theorem to # and conclude that there ts 
(a. f(a)) some x in (a,b) such that 
: 7 (b)— f(a) 
x ee er | Oye Bees 
Pa 
FIGURE 12 so that 


f(b) - {NO j 


b-a 


i 


Notice that the Mean Value Theorem still fits into the pattern exhibited by 
previous theorems —information about f yields information about f’. ‘Vhis mfor- 
mation is so strong, however, that we can now go in the other direction. 


COROLLARY 1 If f is defined on an interval and f’(x) = 0 for all x in the interval, then f is 
constant on the interval. 


PROOF Let a and b be any two points in the interval with a 4 b. Then there ts some x im 
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(a,b) such that 
H{D) — fla) 


b-—a 


f(x) = 


But f'() = Odor ally im the anterval, so 


ae! 2) = fhe) 


) 
b-a 


5 


and consequently f(a) = f(b). Thus the value of f at any two points in the 
interval is the same, ie., f is constant on the interval. J 


Naturally, Corollary | does not hold for functions defined on two or more in- 
tervals (Figure 13). 


If f and g are defined on the same interval, and f(x) = g'(x) for all xin the 
interval, then there is some number c such that f = g +c. 


For all x in the interval we have (f — g)/(x) = f’(x) — ¢/(x) = 0 so, by Corollary 1, 
there is a number c such that f—g =c. J 


The statement of the next corollary requires some terminology, which is illus- 
trated in Figure 14. 


A function is increasing on an interval if f(a) < f(b) whenever a and b are 
two numbers in the interval with a < b. The function f is decreasing on 
an interval if f(a) > f(b) for all a and b in the interval with a < b. (We 


often say simply that f is increasing or decreasing, in which case the interval is 


understood to be the domain of ff.) 


If f’(x) > O for all x m an interval, then f is increasing on the interval; if f’(x) < 0 
for all x m the interval, then f is decreasing on the interval. 


Consider the case where f’(x) > 0. Let a and b be two points in the interval with 
a <b. Then there is some x in (a,b) with 


Pb) — oe 


es b—-a 
But? Ge Oter all mm (a,b), so 


f(b) — fla) 
ee 
b-a 


0. 


Since b—a > 0 it follows that f(b) > f(a). 
The proof when f’(x) < 0 for all x is lefi to you. J 
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Notice that although the converses of Corollary | and Corollary 2 are true (and 
obvious), the converse of Corollary 3 is not true. If f is increasing, it 1s easy to 
see that f’(x) => 0 for all x, but the equality sign might hold for some x (consider 
i) Soa) 

Corollary 3 provides enough mformation to get a good idea of the graph of 
a function with a mimmal amount of point plotting. Consider, once more, the 


function f(x) =x? — x. We have 


7 at 3e- — I 


We have already noted that f’(x) = 0 for x = ¥1/3 and x = —J/1/3, and it is 
also possible to determine the sign of f’(x) for all other x. Note that 3x7 — 1 > 0 
precisely when 


che es 
ae l 
oo Bi 
| x spy or ee = — AS 
1 i is thus 3x2 — | <0 precisely when 
(a) an increasing function PW Saray earl yy. 


Thus f is mcreasing for x < — 1/3, decreasing between —/1/3 and 1/3, 
and once again increasing for x > /1/3. Combiming this information with the 
following facts 


(1) ofi(=+/ 1a = S/ 1/33 


| f(J1/3) = -§V1/3. 
iat 3 : 2)°f @)=Olfer x =—1, Only 


(3) f(x) gets large as x gets large, and large negative as x gets large negative, 


(b) a decreasing function 
FIGURE 14 it is possible to sketch a pretty respectable approximation to the graph (Figure 15). 
By the way, notice that the intervals on which f increases and decreases could 
have been found without even bothermg to examine the sign of f’. For example, 
smce f’ is continuous, and vanishes only at aay 1/3 and Waly 3 we know that /’ 
always has the same sign on the interval (ant (Ss 3 Since fey uo. = 
f Ae it follows that f decreases on this interval. Similarly, f’ always has the 
same sign on (/1/3, co) and f(x) is large for large x, so f must be increasing on 
Wee oo). Another pomt worth noting: If f’ is continuous, then the sign off’ 
on the interval between two adjacent critical points can be deterniuned simply by 
finding the sign of f’(x) for any one x in this interval. 
Our sketch of the graph of f(x) = x* — x contains sufficient: information 
to allow us to say with confidence that = 3 is a local maximum pomt, and that 
is is a local minimum poimt. In fact, we can give a general scheme for decid- 
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f increasing f decreasing 


FIGURE 15 


ing whether a critical point is a local maximum point, a local minimum point, or 


neither (Figure 16): 


(1) if f’ > O in some interval to the left of x and f’ < 0 in some interval to 
the right of x, then x is a local maximum point. 

(2) if f’ < O in some interval to the left of x and f’ > O in some interval to 
the right of x, then x is a local minimum point. 

(3) if f’ has the same sign in some interval to the left of x as it has in some 
interval to the right, then x is neither a local maximum nor a local minimum 
point. 


(There is no point in memorizing these rules—you can always draw the pictures 
yourself.) 

The polynomial functions can all be analyzed in this way, and it is even possible 
to describe the general form of the graph of such functions. ‘To begin, we need a 


5 2 x 5 
<3 on et —— os 
Tf =O i <= a One 0 lfsopso f-a0 ff <0 
(a) (b) (c) (d) 


FIGURE 16 
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J NCCU Sey IZ 


FIGURE 18 


(0, 0) 
2 


result already mentioned in Problem 3-7: If 


l 


f(x) = a aie Gnaix— eee Ie Os 


then f has at most n “roots,” i.¢., there are at most nm numbers x such that 


f(x) = 0. Although this is really an algebraic theorem, calculus can be used 
to give an casy proof. Notice that if x; and x2 are roots of f (Figure 17), so that 
f(a) = fQ2) = 0, then by Rolle’s Theorem there is a number x between x, 


and x2 such that f’(x) = 0. This means that if f has k different roots x1 < x2 < 
- < xz, then f’ has at least k — 1 different roots: one between x; and x2, one 
between x2 and x3, ete. It is now easy to prove by induction that a polynomial 


function 


| 


LAD = Gix- ie Gai + a + ag 


has at most n roots: ‘The statement is surely true for a = 1, and if we assume that 
it is true for n, then the polynomial 


6) p— Dat + b,x" +--+ bo 


could not have more than n + | roots, since if it did, g’ would have more than n 
roots. 


With this information it is not hard to describe the graph of 
f(x) = a,x" + aye Ripe anes 


The derivative, being a polynomial function of degree n — 1, has at most 
n— 1 roots. Therefore f has at most 2 — | critical points. Of course, a criti- 
cal point is not necessarily a local maximum or minimum point, but at any rate, 
if a and b are adjacent critical points of f, then f’ will remain either positive or 
negative on (a,b), since f’ is continuous; consequently, f will be either creasing 
or decreasing on (a,b). Thus f has at most 2 regions of decrease or merease. 


As a specific example, consider the function 
es pie De 

Since 
f(x) = 40 — 40 = 4x —- DO +h, 


the critical points of f are —1, 0, and 1, and 


ae 1. 
f (0) =0. 
fda)y=-l. 


The behavior of f onthe intervals between the critical points can be determined 
by one of the methods mentioned before. In particular, we could determine the 
sien of f’ on these intervals simply be examining the formula for f’(x). On the 
other hand, from the three critical values alone we can see (Iigure 18) that f 
increases on (—1,0) and decreases on (QO. 1). ‘To determine the sign of f’ on 
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(—oo, —1) and (1, 00) we can compute 


f'Q)=4.2 =4.2= 24 


and conclude that f is decreasing on (—oo, —1) and increasing on (1, 00). These 
conclusions also follow from the fact that f(x) is large for large x and for large 
negative x, 

We can already produce a good sketch of the graph; two other pieces of mfor- 
mation provide the finishing touches (Figure 19). First, it is easy to determine that 
fx) =0 tore, +/2. second, it is clear that f is even, f(x) = f(—+x), so the 
graph is symmetric with respect to the vertical axis. The function f(x) = x? — x, 
already sketched in Figure 15, is odd, f(x) = —f(—.x), and is consequently sym- 
metric with respect to the origin. Half the work of graph sketching may be saved 
by noticing these things in the beginning. 


to 


ie) = x 28 


allie) oe 1)} 
FIGURE 19 


Several problems in this and succeeding chapters ask you to sketch the graphs 
of functions. In each case you should determine 


l 
(2) the value of f at the critical points, 
(3) the sign of f’ in the regions between critical points (if this is not already 


) the critical points of f, 


clear), 
(4) the numbers + such that f(+) = 0 (if possible), 
(5) the behavior of f(x) as x becomes large or large negative (if possible). 


Finally, bear in mind that a quick check, to see whether the function is odd or 
even, may save a lot of work. 

This sort of analysis, if performed with care, will usually reveal the basic shape 
of the graph, but sometimes there are special features which require a little more 
thought. It is impossible to anticipate all of these, but one piece of information is 
often very important. If f is not defined at certain points (for example, if f 1s a 
rational function whose denominator vanishes at some points), then the behavior 
of f near these points should be determined. 

lor example, consider the function 
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which is not defined at 1. We have 


mes) Gaye 
ae 2) 
(x = 12" 
Thus 
(1) the critical points of f are 0, 2. 
Moreover, 


(2) f(O) = —2, 
f(2) =2. 


Because f is not defined on the whole interval (0, 2), the sign of f’ must be 
determined separately on the intervals (0, 1) and (1, 2), as well as on the intervals 
(—oo, 0) and (2, o©). We can do this by picking particular points in each of these 
intervals, or simply by staring hard at the formula for f’. Either way we find that 


G)fa)s8 1 a20 
ij G@icg0 tO wal 
ff Up=O0 if |) —tee Be 
£ (a) > 0 gil. a2 <x. 


Finally, we must determine the behavior of f(x) as x becomes large or large 
negative, as well as when x approaches | (this information will also give us another 
way to determine the regions on which f increases and decreases). ‘lo examine 
the behavior as x becomes large we write 

x*—2x+2 | 
———$— =x-]l4+—; 
mail a 
clearly f(x) is close to x — | (and slightly larger) when x is large, and f(x) is close 
to x — | (but slightly smaller) when x 1s large negative. ‘Vhe behavior of f near | 
is also easy to determine; since 


lim (x> Sy 2 ZO, 


the fraction 
x*, = 25 +2 
x-1 

becomes large as x approaches | from above anid large negative as x approaches | 
from below. 

All this information may seem a bit overwhelming, but there is only one way 
that it can be pieced together (Figure 20); be sure that you can account for each 
feature of the graph. 


When this sketch has been completed, we might note that it looks like the graph 


THEOREM 5 


PROOF 
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FIGURE 20 


of an odd function shoved over | unit, and the expression 


ee eg —al)- el 
x-—1 = x—1 
shows that this 1s indeed the case. However, this 1s one of those special features 


which should be investigated only after you have used the other information to get 
a good idea of the appearance of the graph. 


Although the location of local maxima and minima of a function 1s always re- 
vealed by a detailed sketch of its graph, it is usually unnecessary to do so much 
work. ‘There is a popular test for local maxima and minima which depends on the 
behavior of the function only at its critical points. 


Suppose f’(a) = 0. If f”(a) > 0, then f has a local minimum at a; if f"(a) < 0, 
then f has a local maximum at a. 


By definition, 


i. hy) — f! 
7, @) = lim of (aa se Goss (ay 
h—>0 h 


Since f’(a) = 0, this can be written 


r } 
f(a) = lim sees) ey 
h>0 h 
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Suppose now that f”(a) > 0. Then f"(a +/)/h must be positive for sufficiently 
small h. ‘Therefore: 


f(a +h) must be positive for sufficiently small h > 0 
and f’(a +h) must be negative for sufficiently small h < 0. 


‘his means (Corollary 3) that f is increasing in some interval to the right of a 
and f is decreasing in some interval to the left of a. Consequently, f has a local 
minimum at a. 

The proof for the case f(a) < 0 is similar. § 


eas 
Ns Theorem 5 may be applied to the function f(x) = x3 — x, which has already 
(a) been considered. We have 
OE 
dO 
f(x) = x4 Al 
| At the critical points, — / 1/3 and /1/3, we have 
en WS pen 1S 0) 
f(y) 1/3 ee Ons 
(b) Consequently, —/1/3 is a local maximum point and /1/3 is a local minimum 


pot. 

Although Theorem 5 will be found quite useful for polynomial functions, for 
many functions the second derivative is so complicated that it is easier to consider 
the sign of the first derivative. Moreover, if @ is a critical point of f it may happen 
that f"(a) = 0. In this case, Theorem 5 provides no information: it is possible 
that a@ is a local maximum point, a local minimum point, or neither, as shown 
(Figure 21) by the functions 


(c) 


PGW RE 2 I 


f(x) = —x", to) = cs fa= oe 


in each case f'(0) = f”(0) = 0, but O is a local maximum point for the first, a 
local minimum point for the second, and neither a local maximum nor minimum 
pomt for the third. ‘This point will be pursued further in Part IV. 

It is interesting to note that ‘Vheorem 5 automatically proves a partial converse 
of itself. 


THEOREM 6 = Suppose f”(a) exists. If f has a local minimum at a, then f"(a) > 0; if f has a 
local maximum at a, then f"(a) <0. 


PROOF Suppose f has local minunum at a. If f"(a) < 0, then f would also have a 
local maxunum at a, by Vheorem 5. ‘Thus f would be coustant im some interval 
containing a, so that f”(a) = 0, a contradiction. “Vhus we must have f”(a) => 0. 


The case of a local maximunti is handled similarly. J 


GaSe 2 


THEOREM 7 


PROOF 
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(This partial converse to Theorem 5 is the best we can hope for: the > and < 
sigs cannot be replaced by > and <, as shown by the functions f(x) = x7 and 
fo). 3) 

‘The remainder of this chapter deals, not with graph sketching, or maxima and 
minima, but with three consequences of the Mean Value Theorem. The first is a 
simple, but very beautiful, theorem which plays an mportant role in Chapter 15, 
and which also sheds hght on many examples which have occurred in previous 
chapters. 


Suppose that f ts continuous at a, and that f’(v) exists for all x in some mterval 
containing a, except perhaps for x = a. Suppose, moreover, that lim f’(x) exists. 
2 A= 


Then f’(a) also exists, and 


ae bin f (xe 


By definition, 
} = ‘. 
f @=im J hasta 1G) 


For sufficiently small h > 0 the function f will be continuous on {a,a+/] and 
diflerentiable on (a,a +h) (a similar assertion holds for sufficiently small ft < 0). 
By the Mean Value Theorem there is a number a, in (a,a +h) such that 


(eee J (a) 
h 


Now a, approaches a as ht approaches 0, because a, is in (a,a +h); since 


= f' (an). 


lim f’(x) exists, it follows that 


aC: 


fh 
f @) =m ee = hint f (@,) — lin f Ga. 
h—0 h h—0 xa 


(It is a good idea to supply a rigorous ¢-5 argument for this final step, which we 
have treated somewhat informally.) § 


Even if f is an everywhere diflerentiable function, it is still possible for f’ to be 
discontinuous. ‘This happens, for example, if 


ae! 
Xsii= 4 0 
0. jo — 0s 


According to ‘Theorem 7, however, the graph of f’ can never exhibit a disconti- 
nuity of the type shown in Figure 22. Problem 61 outlines the proof of another 
beautiful theorem which gives further information about the function f’, and Prob- 
lem 62 uses this result to strengthen ‘Theorem 7. 

The next theorem, a generalization of the Mean Value Theorem, is of interest 
mainly because of its applications. 
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THEOREM 8 (THE CAUCHY MEAN 
VALUE THEOREM) 


PROOF 


THEOREM 9 (UHOPITAL’S RULE) 


If f and g are continuous on [a,b] and diflerenuable on (a,b), then there is a 
number x m (a,b) such that 


[f(b) — f@]e'@) = [g®) — s(@)] f'@). 

(If g(b) 4 g(a), and g’(x) 4 0, this equation can be written 

f(b) — fla) f') 

gO) ay a Ca 
Notice that if g(x) = x for all x, then g’(x) = I, and we obtain the Mean Value 
Theorem. On the other hand, applying the Mean Value Theorem to f and g 
separately, we find that there are x and y in (a, b) with 

sub) = fa) _ f'), 

gb) — g(a) Vey) 
but there is no guarantee that the x and y found in this way will be equal. ‘Vhese 


remarks may suggest that the Cauchy Mean Value ‘Theorem will be quite difficult 
to prove, but actually the simplest of tricks suffices.) 


Iho 
h(x) = fix) gb) = g(a)| —'g QF) — fF @]. 


Then / is continuous on [a, b], differentiable on (a,b), and 
h(a) = fla)g(b) — g(a) f(b) = hb). 


It follows from Rolle’s ‘Theorem that h’(x) = 0 for some x in (a, b), which means 
that 
0= f'(~)[g) — g@)] - F@Lf®) — f@).1 


The Cauchy Mean Value Theorem is the basic tool needed to prove a theorem 
which facilitates evaluation of hmiuts of the form 


when 
lim f (x) S,0,...aniclsehnnee (j= 0: 


x~—a Aa 
In this case, Theorem 5-2 is of no use. Every derivative is a hmit of this form, and 
computing derivatives frequently requires a great deal of work. Ifsome derivatives 
are known, however, many limits of this form can now be evaluated easily. 


Suppose that 
lm f(%)=0 and “hinivi)—0; 


dota P God 0! 


and suppose also that lim f’(x)/g’(x) exists. Phen him f(x)/g(¥) exists, and 
Ao tei "ou 


(Notice that ‘Theorem 7 is a special case.) 


PROOF 
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The hypothesis that lim f’(x)/g’(x) exists contains two implicit assumptions: 
te 


(1) there is an interval (a —5,a+6) such that f’(x) and g’(x) exist for all x in 
(a= OF Gao Nexcepurpernaps tor + = a, 

(2) in this interval g’(x) #4 O with, once again, the possible exception 
of w =Ke 


On the other hand, f and g are not even assumed to be defined at a. If we define 
f(a) = g(a) = O (changing the previous values of f(a) and g(a), if necessary), 
then f and g are continuous at a. If a < x < a+, then the Mean Value 
Theorem and the Cauchy Mean Value Theorem apply to f and g on the interval 
[a,x] (and a similar statement holds for a — 6 < x <a). First applying the Mean 
Value Theorem to g, we see that g(x) 4 0, for if g(x) = 0 there would be some x 
in (a,x) with g’(x;) = 0, contradicting (2). Now applying the Cauchy Mean Value 
Theorem to f and g, we see that there is a number @, in (a,x) such that 


[ f(x) — O]g’(a.) = [g(x) — O) (ax) 


or 
TAX) iz N Ge 
RC) 0 CP | 


Now a, approaches a as x approaches a, because a, is in (a,x); since we are 
assuming that lim f’(y)/g’(y) exists, it follows that 
ya 
ViCoe. FACa me lin 10) 


lim = lm = in ; 
x—a 2(x) xa g' (ay) yoa g’(y) 


(Once again, the reader is invited to supply the details of this part of the argu- 
ment.) § 


PROBLEMS 


1. For each of the following functions, find the maximum and minimum values 
on the indicated intervals, by finding the points in the interval where the 
derivative 1s 0, and comparing the values at these points with the values at 
the end points. 


Gi) f(x) =at7 =x? —8x+1 on [-2, 2]. 


i) (@)=_ eae! on fal Uy 

(ii) *fGcy S838 =P Ox? Bon [-5. 5}. 

: a l l 

(iv) Alice cups | (oh re ie 
x+1 

(ee 8 to aa on [—1, 4]. 

on (Coe : om [Uae 


z 
x-*—] 
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De 


3: 


4. 


Ds 


Now sketch the graph of each of the functions in Problem 1, and find all 
local maximum and minimum points. 


Sketch the graphs of the following functions. 


(a) 


*(b) 


l 
fj &) =x -- oi 
3 
1 Oo)i— XIE 7" 
f@==—. 
ve 1+ x2 
If ay < +--+ < dy, find the minimum value of f(x) = yie Sane. 


=| 
n 


Now find the minimum value of f(x) = a |x — a;|. This is a problem 
i 

where calculus won't help at all: on the intervals between the a;’s the 
function f is linear, so that the minimum clearly occurs at one of the aj, 
and these are precisely the points where /f is not differentiable. However, 
the answer is easy to find if you consider how f(x) changes as you pass 
from one such interval to another. 

Let a > 0. Show that the maximum value of 


| | 
Ps 1 + |x| z 1+ |x —al 


is (2+a)/(1 +a). (The derivative can be found on each of the intervals 
(—oo, 0), (0, a), and (a, 00) separately.) 


For each of the following functions, find all local maximum and minimum 


points. 
Ge eS OP a9 
SS Y= 
CG) Ga ae 8) oe 
| ae da 
et SOO 


x irrational 
1/q, x = -p/q in lowest terms. 
5 ta) x ravonal 
f(x) = ae 
Ost “x irrational: 
tf; x= 1/n forsome nan N 
0, otherwise. 
1, if the decimal expansion of x contains a 5 
0, otherwise. 


(1, Db) 


IG URS e2 3 


NED 10. 
SS 


h 


Surface area is the 


sum of these areas | ~~, 


tz. 


FIGURE 24 _~ 


13; 
14. 


15. 


PIGURE 25 
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Prove the following (which we often use mplicitly): [If f is mcreasing on (a, b) 
and continuous at a and b, then f is increasing on [a, b]. In particular, if f 
is continuous on [a,b] and f’ > 0 on (a,b), then f is increasing on [a, b]. 


A straight line is drawn from the point (0,a) to the horizontal axis, and 
then back to (1,4), as in Figure 23. Prove that the total length is shortest 
when the angles @ and B are equal. (Naturally you must bring a function 
into the picture: express the length in terms of x, where (x, 0) is the poimt 
on the horizontal axis. ‘The dashed line in Figure 23 suggests an alternative 
geometric proof; in either case the problem can be solved without actually 


finding the point (x, 0).) 


(a) Let (x9, yo) be a point of the plane, and let L be the graph of the function 
f(x) =mx +b. Find the point + such that the distance from (x9, yo) to 
(x, f(X)) is smallest. [Notice that mimimizing this distance is the same as 
minimizing its square. ‘This may simplify the computations somewhat. | 

(b) Also find x by noting that the line from (x9, yo) to (¥, f(%)) is perpen- 
dicular to L. 

(c) Find the distance from (x9, yo) to L, 1.e., the distance from (xo, vo) to 
(x, f(¥)). [ft will make the computations easier if you first assume that 
b = 0; then apply the result to the graph of f(+) = mx and the point 
(xo. yo — b).| Compare with Problem 4-22. 

(d) Consider a straight line described by the equation Ax + By + C = 
0 (Problem 4-7). Show that the distance from (x9, yo) to this line is 


(Axo + Byo + C)/V A2 + B?. 


‘The previous Problem suggests the followmg question: What is the relation- 
ship between the critical points of f and those of f?? 


Prove that of all rectangles with given perimeter, the square has the greatest 
area. 


Find, among all mght circular cylinders of fixed volume V, the one with 
smallest surface area (counting the areas of the faces at top and bottom, as 
in Figure 24). 


A right triangle with hypotenuse of length a is rotated about one of its legs 
to generate a right circular cone. Find the greatest possible volume of such 
a cone. 


Show that the sum of a positive number and its reciprocal is at least 2. 


Find the trapezoid of largest area that can be inscribed in a semicircle of 
radius a, with one base lying along the diameter. 


‘Two hallways, of widths a and b, meet at right angles (Figure 25). What 
is the greatest possible length of a ladder which can be carried horizontally 
around the corner? 
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FIGURE 26 
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FIGURE 30 


A garden is to be designed in the shape of a circular sector (Figure 26), with 
radius R and central angle 6. The garden is to have a fixed area A. For 
what value of KR and @ (in radians) will the length of the fencing around the 
perimeter be minimized? 


A right angle is moved along the diameter of a circle of radius a, as shown 
in Figure 27. What is the greatest possible length (A + B) intercepted on it 
by the circle? 


Ecological Ed must cross a circular lake of radius | mile. He can row across 
at 2 mph or walk around at 4 mph, or he can row part way and walk the 
rest (Figure 28). What route should he take so as to 


(i) see as much scenery as possible? 
(1) cross as quickly as possible? 


(a) Consider points A and B on a circle with center O, subtending an angle 
of a = ZAOC (Figure 29). How must B be chosen so that the sum of 
the areas of AAOB and ABOC is a maximum? Hint: Express things 
in terms of 6 = ZAOB. 

(b) Prove that for n > 3, of all n-gons inscribed in a circle, the regular u-gon 
has maximum area. 


The lower right-hand corner of a page is folded over so that it just touches 
the left edge of the paper, as in Figure 30. If the width of the paper is @ and 
the page is very long, show that the minimum length of the crease is 3V3a/4. 


Figure 31 shows the graph of the denvative of f. Find all local maximum and 
minimum points of f. 


Fi Ga Rasa 


Suppose that f is a polynomial function, f(x) = x" + a@,—yx"~! +--+ + a0, 
with critical pots —1, 1, 2, 3, 4, and corresponding critical values 6, 1. 2, 
4,3. Sketch the graph of f, distnguishing the cases 7 even and 1 odd. 


(a) Suppose that the critical pomts of the polynomial function f (+) = +" + 
dpe ee -Lagare=al a 2S, and Al) — 0, 7 (= 0 fF Cre 
0, f"(3) = 0. Sketch the graph of f as accurately as possible on the 
basis of this information. 

(b) Does there exist a polynomial function with the above properties, except 
that 3 is not a critical point? 


Describe the graph of a rational function (in very general terms, similar to 
the text's deseription of the graph of a polynomial function). 


25. 


26. 


aye 


28. 


2g. 


30. 


oh. 
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(a) Prove that two polynomial functions of degree m and n, respectively, 
intersect in at most max(m, 2) points. 

(b) For each m and nv exhibit two polynomial functions of degree m and n 
which intersect max(m, 7) times. 


Suppose f is a polynomial function of degree n with f > 0 (son must be 

even). Prove that f + f’+ f” +---+ f™ = 0. 

(a) Suppose that the polynomial function f(x) = x” + a,-yx""! +++» +.a9 
has exactly k critical points and f(x) 4 0 for all critical points +. Show 
that n — k is odd. 

(b) For each n, show that if  —k is odd, then there is a polynomial function 
f of degree n with k critical points, at each of which f” is non-zero. 

(c) Suppose that the polynomial function f(x) = x" + poe ee ee 
has k; local maximum points and kz local minimum points. Show that 
ky =k, + 1 if n is even, and ky = ky if n is odd. 

(dl) Let n, ky, k2 be three integers with ky = ky + Lif n is even, and kp = ky if 
nis odd, and ky +k2 <n. Show that there is a polynomial function f of 
degree n, with ky local maximum points and kz local minimum points. 

ky+ko 
ink: Pick a) <a> <---> < @&,4,,(and ta foo I] (x—a;)-( a”)! 
for an appropriate number /. el 


(a) Prove that if f’(~) > M for all x in [a,b], then f(b) > f(a)+M(b—-a). 
(b) Prove that if f’(x) < M for all x in [a, bj, then f(b) < f(qv+M(b—a). 
(c) Formulate a similar theorem when | f’(x)| < M for all x in [a, 5]. 


Suppose that f(x) > M > 0 for all x in [0, 1]. Show that there is an interval 
of length t on which | f| > M/4. 


(a) Suppose that f’(v) > g’(x) for all x, and that f(a) = g(a). Show that 
f@) > 3) tome ahah) = 2 6 wore. 

(b) Show by an example that these conclusions do not follow without the 
hypothesis f(a) = g(a). 

(c) Suppose that f(a) = g(a), that f’(x) > g’(x) for all x, and that f’(x0) > 
g (vq) for some Xeieea. Showathat f(x) > (x) for all x => xo. 


Find all functions f such that 


Oa) siliece 

(Dy) ef (ee) = x? 

i f"OR= x 

Although it is true that a weight dropped from rest will fall s(f) = 1617 
feet after ¢ seconds, this experimental fact does not mention the behavior of 
weights which are thrown upwards or downwards. On the other hand, the 
law s”(t) = 32 is always true and has just enough ambiguity to account for 
the behavior of a weight released from any height, with any initial velocity. 
kor simplicity let us agree to measure heights upwards from ground level: 
in this case velocities are positive for rising bodies and negative for falling 
bodies, and all bodies fall according to the law s”(1) = —32. 
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63. 


ot. 


35. 


36. 


oT: 


(a) Show that s is of the form s(t) = -16r? + at + B. 

(b) By setting ¢ = O in the formula for s, and then in the formula for s’, 
show that s(t) = —16t? + vot +9, where so is the height from which the 
body is released at time O, and vp is the velocity with which it is released. 

(c) A weight is thrown upwards with velocity v feet per second, at ground 
level. How high will it go? (“How high” means “what is the maximum 
height for all times”.) What is its velocity at the moment it achieves its 
greatest height? What is its acceleration at that moment? When will it 
hit the ground again? What will its velocity be when it hits the ground 
again? 


A cannon ball is shot from the ground with velocity v at an angle @ (Fig- 
ure 32) so that it has a vertical component of velocity vsin@ and a hori- 
zontal component vcos@. Its distance s(t) above the ground obeys the law 
s(t) = —16r* + (vsina)t, while its horizontal velocity remaims constantly 
U COS. 


(a) Show that the path of the cannon ball is a parabola (find the position at 
each time f, and show that these points lie on a parabola). 
(b) Find the angle @ which will maximize the horizontal distance traveled 
by the cannon ball before striking the ground. 
(a) Give an example of a function f for which hm f(+) exists, but 
05 — Me, S) 
lim f’(x) does not exist. 
5 iA, Gi) 
(b) Prove that if lim f(x) and hm f’(x) both exist, then lm f’(x) = 0. 
xXxOoO Xx—>>O0O X—>OO 
(c) #Prove-that if 4int f(x) exists'and lim f(x) exists, then lim f"’(x) = 0: 
Os DVS, 2) XO 
(See also Problem 20-22.) 


Suppose that f and g are two diflerentiable functions which satisfy 
fet Ff 2 =0.Prove tat af “fta) = 0 and e(a) FO, then /(v) =0 for all x 
in an interval around a. Hint: On any interval where f/g is defined, show 
that it is constant. 


Suppose that | f(x) — fGy)| < |x — y|" fora > 1. Prove that f is constant by 
considering f’. Compare with Problem 3-20. 


A function f is Lipschitz of order a at x if there is a constant C such that 
(6) Oy fy re Cle — vi" 


for all y in an interval around x. The function f is Lipschitz of order ce on an 
interval if (*) holds for all x and y in the interval. 


(a) If f is Lipschitz of order a > 0 atx, then f is contmuous at x. 

(b) If f is Lipschitz of order a > 0 on an interval, then f is uniformly 
continuous on this interval (see Chapter 8, Appendix). 

(c) Wf yes differennablevatx them f is Lipschitz of ortlér Tat 1. Js ihe 
converse true? 

(d) If f is differentiable on [a,b], is f Lipschitz of order 1 on [a, b]? 

(ec) If f is Lipschitz of order @ > 1 on [a,b], then f is constant on [a, )]. 


38. 


oo. 


40. 


41. 


@42. 


43. 


44. 


45. 


11. Significance of the Derivative 211 


Prove that if 
ay ay "6s 


| yi 1 


then 
ag tayx +-+++ta,x" =0 


for some x in (0, 1). 


Prove that the polynomial function fi, (x) = x3 —3x +m never has two roots 
in [0, I], no matter what m may be. (This is an easy consequence of Rolle’s 
Theorem. It is mstructive, after giving an analytic proof, to graph fo and fo, 
and consider where the graph of f,, lies m relation to them.) 


Suppose that f is continuous and differentiable on [0,1], that f(x) is in 
[0, 1] for each x, and that f’(x) 4 1 for all x in [0, 1]. Show that there is 
exactly one number x in [0,1] such that f(x) = x. (Half of this problem 
has been done already, in Problem 7-11.) 


“ . p 9} pr p + . 
(a) Prove that the function f(«) = x* —cos.x satisfies f(x) = 0 for precisely 
two numbers x. 
+ . 9) . 
(b) Prove the same for the function f(x) = x° — x sinx — cosx. 
. ad 7 . a) ‘4 2) a 
*(c) Prove this also for the function f(x) = 2x° — xsinx — cos“ x. (Some 
preliminary estimates will be useful to restrict the possible location of the 
zeros of f.) 


(a) Prove that if f is a twice differentiable function with f(0) = O and 
f(tS=sleand a Oa "( 1). = 0, thent| ("()| = 4orsome ¢ in (0; 1): 
In more picturesque terms: A particle which travels a unit distance in 
a unit time, and starts and ends with velocity 0, has at some time an 
acceleration > 4. Hint: Prove that either f”’(x) > 4 for some x in (0, 5), 
or else f”(x) < —4 for some x in G. 1). 

(b) Show that in fact we must have | f”(+)| > 4 for some x m (0, 1). 


Suppose that f is a function such that f’(v) = 1/x for all x > Oand f(1) = 
0. Prove that f(xy) = f(x) + £0) for all x, y > 0. Hint: Find g’(x) when 
g(x) = f(xy). 


Suppose that f satisfies 
P(x) + fF @g(x) — f(x) = 0 


for some function g. Prove that if f is 0 at two pomts, then f is 0 on the 
mterval between them. Hint: Use Theorem 6. 


Suppose that f 1s continuous on [a,b], that it is n-times diflerentiable on 
(a, b), and that f(x) = 0 for n+1 different x im [a,b]. Prove that f(x) = 0 
for some x m (a, b). 
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46. 


47. 


48. 


49. 


50. 


Hal be 


Let %1,...,%,41 be arbitrary poimts in [a, b], and let 


n+l 
Q(x) =| [@ — x). 

i= 
Suppose that f is (2 + 1)-times differentiable and that P is a polynomial 
function! degree < ie suich that P(x;))—efGy tore — Il. 2m + Iisce 
Problem 3-6). Show that for each x in [a,b] there is a number c in (a, b) 
such that 
yee (c) 
x) — P(x) = O(a) - ——_.. 
f(x) — P(x) = O%) mri 


Hint: Consider the function 


F(t) = O@)[FO — PO] — QW[FG) — P@)]. 
Show that F is zero at n + 2 different points in [a,b], and use Problem 45, 


Prove that 


5 < V66-—8 < é 
without computing V66 to 2 decimal places!). 
| 2 | 


Prove the following shght generalization of the Mean Value ‘Theorem: If f 
is continuous and differentiable on (a,b) and lim f(y) and lim f(y) exist, 
yob 


yo>at 


then there 1s some x in (a,b) such that 


lim f(y) — lm f(y) 

F yob- y>at 

f OC) St 

b—a 

(Your proof should begin: “This is a trivial consequence of the Mean Value 


Theorem because ... ”.) 


Prove that the conclusion of the Cauchy Mean Value Theorem can be written 
in the form 


SO). 9 ED 

g(b)— gla) g'(x) 
under the additional assumptions that g(b) 4 g(a) and that f’(x) and g’(x) 
are never simultaneously 0 on (a,b). 
Prove that if f and g are continuous on [a.b| and differentiable on (a, b), 
and g’(x) 4 0 for x in (a, b), then there is some x in (a, b) with 

Co Coen (at) 

g(x) g(b)— g(x) 


Mint: Multiply out first, to see what this really says. 


What is wrong with the following use of PHopital’s Rule: 
23) : 9 2 Bu | 6x 
Ne at eee m0 ap : x 
hii —————- —- = 
xol xe —3x4+2 vol 2x —3 xol 2 


(Vhe limit is actually —4.) 


52. 


a6 


54. 


55. 
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Find the following limits: 


a) lim 
x0 tan x 
ay 
COS” X = | 
ai) hm —— 
, x>0 Oa 


Find f’(O) if 
g(x) 
f(x)= x 
(), x= 0, 


and 2(O)i= ¢ (O)mes Ovaries (0) =al7. 


Prove the following forms of PH6pital’s Rule (none requiring any essentially 
new reasoning). 


(a) lf dim F(X) = plinige (ga — On “aid him. (aye () 9 then 


x—at x—at 


him f(x)/g(x) =1 (and similarly for limits from below). 


(by If lim f(x) =. Inge) =" OF ande@lin "yj @)/¢@) = oo, then 


Abs 
lim f(x)/g(x) = oo (and similarly for —oo, or if x — a 1s replaced 
Ce 
by x > at orx >a). 


(c) If Junge / @) «=e Gee ans lim f'(x)/e') S 4, then 
i— iO xXx— OO X— 0O 


lim f(x)/g(x) = JI (and similarly for —oo). Hint: Consider 
28 — AS, 2) 
lim f/x)/8 0/2), 
(qd) it int f@)) =slim so 0, and lm /'(4)/2 Cy) .—soasmiich 
XO TS Fee x00 


lim f(x)/g(@@) = o. 
xX 0O 
There is another form of ?H6pital’s Rule which requires more than algebraic 
manipulations: H fin fje— lim gv) = co, and? lm ff (x)/e (x) = 7, 
X—0O X—> CO X—0O 


then lm f(+)/g(x) =I/. Prove this as follows. 
36 O2, 


(a) For every ¢ > 0 there is a number a such that 


| f'@) 
pale) 


= lite ior eg: 


Apply the Cauchy Mean Value Theorem to f and g on [a,x] to show 
that 
fa)—- f@ 
g(x) — g(a) 


ee ON. ae 


(Why can we assume g(x) — g(a) 4 0?) 
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56. 


37. 


58. 


bY: 


*60. 


61. 


(b) Now write 


fO) _ f@)-—f@ 7 Ow) g(x) — g(a) 
g(x) gi) —ala) f(y—f@ — gx) 
(why can we assume that f(x) — f(a) 4 0 for large x?) and conclude 
that 
Fe) 
g(x) 


=f 


<2e for sufficiently large x. 


‘lo complete the orgy of variations on !Ho6pital’s Rule, use Problem 55 to 
prove a few more cases of the following general statement (there are so many 


possibilities that you should select just a few, if any, that interest you): 

If ho / Opt=elimeeie)— {  } and lim f’G)/2’) = Ce), theneim 
x>[] x=[) x>[] x>[] 

E(x )/ (x) = Gopmmelerc |\|.cati be @OR¢@ Of @ aol CO ole GOeanchiae 

can be 0 or 00 or —o0, and ((__) can be / or 00 or —oo. 


If f and g are differentiable and lim f(x)/g(x) exists, does it follow that 
Xa 


lin f’(x)/g'(x) exists (a converse to FHo6pital’s Rule)? 
Ph oe ot 


Prove that if f’ is increasing, then every tangent line of f intersects the graph 
of f only once. (In particular, this is true for the function f(~) = x" if n is 


even.) 


Redo Problem 10-18 (c) when 
1\2 . I 
= i= res 


(Why is this problem ts this chapter?) 


(a) Suppose that f 1s differentiable on [a,b]. Prove that if the mmimum 
of f on [a, b] is at a, then f’(a) > 0, and if it is at b, then f’(b) < 0. 
(One half of the proof of Theorem 1 will go through.) 

(b) Suppose that f’(a) < O and f(b) > 0. Show that f’(x) = 0 for some x 
in (a,b). Hint: Consider the minimum of f on [a,b]; why must it be 
somewhere in (a, b)? 

(c) Prove thatif f(a) < ¢ < f’(b), then f’(x) =c for some x in (a, b). (This 

result is known as Darboux’s ‘Theorem. Note that we are nod assuming 

that f’ is continuous.) Hint: Cook up an appropriate function to which 
part (b) may be apphed. 


Suppose that f 1s differentiable in some mterval containing a, but that /f” 1s 
discontinuous at a. Prove the following: 


(a) ‘Vhe one-sided limits hin f’(v) and lim f’(x) cannot both exist. (This 


> Cl fou 
is just a minor variation ou ‘Vheorem 7.) 
(b) ‘These one-sided limits caunot both exist even if we allow limits with the 
value +00 or —oo. Hint: Use Darboux’s ‘Theorem (Problem 60). 


“G2: 


*63. 


64. 


65. 


66. 


Gy". 
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It is easy to find a function f such that |f| is differentiable but f is not. 
For example, we can choose f(x) = | for x rational and f(x) = —1 for 
x irrational. In this example f is not even continuous, nor is this a mere 
coincidence: Prove that if | f| is differentiable at a, and f is continuous at a, 
then f is also differentiable at a. Hint: It suffices to consider only a with 
f(a) =0. Why? In this case, what must | f|’(@) be? 


(a) Let.y # O and let ‘n be even. Prove that x” + y” = (& + y)” only 
when x = 0. Hint: If x9” + y” = (xo + y)", apply Rolle’s Theorem to 
PO) Shy ex ey) on, ex: 

(b) Prove that if y 4 0 and n is odd, then x” + y” = (x + y)” only if x = 0 
or x =—y. 

Suppose that f(0) = 0 and f’ is increasimg. Prove that the function g(x) = 

f(x)/x is increasing on (0, co). Hint: Obviously you should look at g’(x). 

Prove that it is positive by applying the Mean Value Theorem to f on the 

right interval (it will help to remember that the hypothesis f(0) = 0 is essen- 

tial, as shown by the function f(x) = 1+ x2), 

Use derivatives to prove that if 7 > 1, then 

Cle)” >t ie for —) = x = Onde) =< x 

(notice that equality holds for x = 0). 


Let f(x) =x7 sin- lx tor 1 0, and let 7710) = OF Picea 33). 


(a) Prove that 0 is a local minnnum point for /. 


(b) Prove that f’(0) = f”(0) = 0. 


This function thus provides another example to show that Theorem 6 cannot 
be improved. It also illustrates a subtlety about maxima and minima that 
often goes unnoticed: a function may not be increasing in any interval to the 
right of a local minimum point, nor decreasing in any interval to the left. 


JOE LOR Bh) 


(a) Prove that if f(a) > O and f’ is continuous at a, then f is creasing in 
some interval containing a. 


‘The next two parts of this problem show that continuity of f” is essential. 


(b) If g(x) = x7 sin 1/x, show that there are numbers x arbitrarily close to 0 
with g’(x) = | and also with g’(x) = —1. 
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(c)mSuppose O@ av < ah. Let*f@) = ax + x? sin 1/x for x 4 0, and let 
f(O) = 0 (see Figure 34). Show that f is not increasing in any open 
interval containing 0, by showing that in any interval there are points x 
with f’(x) > 0 and also points x with f’(x) < 0. 


FIGURE 34 


The behavior of f for a > 1, which is much more difficult to analyze, 1s 
discussed in the next problem. 


Let f(x) = ax +x7sin 1/x for x 4 0, and let f(0) = 0. In order to find 
the sign of f’(x) when a@ > | it is necessary to decide if 2x sin I /x — cos 1/x 
is < —1] for any numbers x close to 0. It is a little more convenient to 
consider the funetion g(y) = 2(sin y)/y — cos y for y 4 0; we want to know 
if g(v) < —1 for large y. This question ts quite delicate; the most significant 
part of g(y) is — cos y, which does reach the value —1, but this happens only 
when sin y = OQ, and it is not at all clear whether g itself can have values 
< —1. The obvious approach to this problem is to find the local minimum 
values of g. Unfortunately, it is impossible to solve the equation g’(y) = 0 
exphitly, so more ingenuity 1s required. 


(a) Show that if g’(y) = 0, then 


2-—y 
Oe ; 


~ 


cos y = (sin y) 
and eonelude that 


g(y) = (sin. y) 


7769, 
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(b) Now show that if g’(y) = 0, then 


4y? 
A+ y4’ 


me 
ay — 


and conclude that 
pe y? 


gQ)| ==. 
yA 


(c) Using the fact that (2 + y?)/V4+ y* > 1, show that if aw = 1, then f is 


not mcreasing in any interval around 0. 
R a _ . ) 4 
(d) Using the fact that lim (2+ y?)/V4 + yt = 1, show that if a > 1, then 
yoo 
f is increasing in some interval around 0. 
A function f is increasing at a if there is some number 6 > 0 such that 


Tt (Ge ald lla oh <a Ga 
and Pe 

ia =f@ Wt a-saex <@ 
Notice that this does not mean that f is increasing in the interval (a — 46, 
a +4); for example, the function shown in Figure 34 is increasing at 0, but 
is NOt an increasing function m1 any open mterval containing O. 


(a) Suppose that f is continuous on [0,1] and that f is increasing at a for 
every a in [0,1]. Prove that f is mcreasing on [0,1]. (First convince 
yourself that there is something to be proved.) Hint: For 0 < b < 1, 
prove that the minimum of f on [b, 1] must be at b. 

(b) Prove part (a) without the assumption that f 1s contmuous, by consider- 
ing for each b in [0, 1] the set S, = {x : f(y) = f(b) for all y in [b,x] } 
(This part of the problem ts not necessary for the other parts.) Hint: 
Prove that Sp = {x : b = x <= 1} by considering sup Sp. 

(c) If f is increasing at a and f is differentiable at a, prove that f’(a) > 0 
(this is easy). 

(d) If f’(a) > 0, prove that f is increasing at a (go right back to the definition 
of f’(a)). 

(ec) Use parts (a) and (d) to show, without using the Mean Value ‘Theorem, 
that if f is continuous on |0, 1] and f’(a) > 0 for all a m [0.1], then f 
is mcreasing on [0, I]. 

(f) Suppose that f is continuous on [0, 1] and f’(a) = 0 for all a in (0, 1). 
Apply part (e) to the function g(x) = f(x) + ex to show that f(1) — 
f (0) > —e. Similarly, show that f(1) — f(0) < e by considering h(x) = 
ex — f(x). Conclude that f(O) = fl). 


This particular proof that a function with zero derivative must be constant has 


many points in common with a proof of H. A. Schwarz, which may be the 
first rigorous proof ever given. Its discoverer, at least, seemed to think it was. 
See his exuberant letter in reference [54] of the Suggested Reading, 
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ae) 


(a) 


(a) 


(b) 


If f is a constant function, then every point is a local maximum pomt 
for f. It is quite possible for this to happen even if f is not a constant 
funation; for example, if ((x) ="Oiom tea and f(s) = lsformes = 
0. But prove, using Problem 8-4, that if f is contmuous on [a,b] and 
every point of [a,b] is a local maximum point, then f is a constant 
function. The same result holds, of course, if every point of [a,b] is a 
local minimum point. 

Suppose now that every point ts either a local maximum or a local mini- 
mum point for the continuous function f (but we don’t preclude the pos- 
sibility that some points are local maxima while others are local minima). 
Prove that f is constant, as follows. Suppose that f(ag) < f(bo). We 
can assume that f(ag) < f(x) < f(bo) for ag < x < bo. (Why?) Using 
‘Theorem | of the Appendix to Chapter 8, partition [ag, bg| to intervals 
on which sup f — inf f < (f(bo) — f(ao))/2; also choose the lengths of 
these intervals to be less than (bg —ag)/2. ‘Then there is one such interval 
[a,, by] with ag < ay < by < bo and f(a,) < f(by). (Why?) Continue 
inductively and use the Nested Interval ‘Theorem (Problem 8-14) to find 
a point x that cannot be a local maximum or minimum. 


A point x is called a strict maximum point for f on Aif f(x) > f(y) 
for all y in A with y # x (compare with the definition of an ordinary 
maximum point). A local strict maximum point is defined in the 
obvious way. Find all local strict maximum poits of the function 


0, x irrational 
fay= 4 1 De 
=, + = — im lowest terms. 
q q 
It seems quite unlikely that a function can have a local strict maximum 
at every point (although the above example might give one pause for 
thought). Prove this as follows. 
Suppose that every pomt is a local strict maximum point for f. Let 
xy; be any number and choose ay < x1; < by with by — ay < 1 such 
that f (1) Sse@ itor all x in [a), Di]. slLet x. Aegebe anyspomiin 
(a,, by) and choose ay < az < x2 < bz < by with bz — a2 < 5 such that 
f (x2) > f(x) for all x in [a2, b2]. Continue m this way, and use the 
Nested Interval Theorem (Problem 8-14) to obtain a contradiction. 


BiGU RE | 


(a, f(a)) 


DEFINITION 1 


(b, f(b) 


DEFINITION 2 
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APPENDIX. CONVEXITY AND CONCAVITY 


Although the graph of a function can be sketched quite accurately on the basis 
of the information provided by the derivative, some subtle aspects of the graph are 
revealed only by examining the second derivative. These details were purposely 
omitted previously because graph sketching is complicated enough without wor- 
rying about them, and the additional information obtained is often not worth the 
effort. Also, correct proofs of the relevant facts are sufficiently difficult to be placed 
in an appendix. Despite these discouraging remarks, the information presented 
here is well worth assimilating, because the notions of convexity and concavity are 
far more important than as mere aids to graph sketching, Moreover, the proofs 
have a pleasantly geometric flavor not often found in calculus theorems. Indeed, 
the basic definition is geometric in nature (see Figure 1). 


A function f is convex on an interval, if for all a and b in the interval, the line 


segment joing (a, f(a)) and (b, f(b)) hes above the graph of f. 


The geometric condition appearing in this definition can be expressed in an 
analytic way that is sometimes more useful in proofs. ‘The straight hne between 
(a, f(a)) and (b, f(b)) is the graph of the function g defined by 


es f(b) — fla), 


g(x) i —ayef@: 
b-—a 


This line hes above the graph of f at x if g(x) > f(x), that 1s, if 


UY Sey —a)+ f(a) > fe) 


b—a 
or 
J Ley —a) > f(x) — f(a) 
b—a 
or 


f(b) — fia) _ fo — fq 


b—a x-—a 


We therefore have an equivalent definition of convexity. 


A function f is convex on an interval if for a, x, and b in the interval with 
a<x <bwe have 


fio) —- f@ : f(b) — fla) 


x-a b—a 
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(a, f (a)) 


Te Gy Rees ee 


(b, f (b)) 


THEOREM 1 


PROOF 


If the word “over” in Definition | is replaced by “under” or, equivalently, if the 
inequality in Definition 2 is replaced by 


LOS) la) x UO) as a) 


xX—-—a b-—a 


we obtain the definition of a concave function (Figure 2). Itis not hard to see that 
the concave functions are precisely the ones of the form —f, where f is convex. 
For this reason, the next three theorems about convex functions have immediate 
corollaries about concave functions, so simple that we will not even bother to 
state them. 

Figure 3 shows some tangent lines of a convex function. Two things seem to be 
true: 


(1) ‘The graph of f hes above the tangent line at (a, f(a)) except at the point 
(a, f(a)) itself (this point is called the point of contact of the tangent Ime). 

(2) If a < b, then the slope of the tangent line at (a, f(a)) is less than the slope 
of the tangent line at (b, f(b)); that ts, f’ is increasing. 


As a matter of fact these observations are true, and the proofs are not difficult. 


FIGURE 3 


Let f be convex. If f is differentiable at a, then the graph of f lies above 
the tangent line through (a, f(a)), except at (a, f(a)) itself. If a < b and f is 
differentiable at a and b, then f’(a) < f’(b). 


If 0 < hy < hy, then as Figure 4 indicates, 


f(at+h) -— f(a) 2 fla+hy) -— fla) 
hy ho 


(1) 
A nonpictorial proof can be derived immediately from Definition 2 applied to 
a<ath, <a+hy. Inequality (1) shows that the values of 


f(at+h) — fla) 
h 
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FIGURE 4 


decrease as h + 0*. Consequently, 


(Gh) —7i@) 
h 
(in fact f’(a) 1s the greatest lower bound of all these numbers). But this means that 
for h > 0 the secant line through (a, f(a)) and (a+h, f(a +h)) has larger slope 
than the tangent line, which implies that (a +h, f(a +h)) lies above the tangent 
line (an analytic translation of this argument 1s easily supplied). 
For negative h there is a similar situation (Figure 5): if hz < hy < 0, then 


f(a+hi) — f(a) e fG@Blo)—Gi@) 
hy h> ; 


(a) = forh > 0 


This shows that the slope of the tangent line is greater than 
f@rh)=F@ 
h 


(in fact f’(a) is the least upper bound of all these numbers), so that f(a +h) lies 
above the tangent line if h < 0. This proves the first part of the theorem. 


forh < 0 


FIGURE 5 
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iat 
aX, Xo b 
FIGURE 7 


LEMMA 


PROOF 


FIGURE 6 


Now suppose that a < b. Then, as we have already seen (Figure 6), 


f(a+(b—a)) — f(a) 
<— 


f'(a) since b—a > 0 
b—-a 
« £6) = f@) 
b-—a 


and 


FO + @—b)) =f) 


since a—b <0 


f:O) = 


a—b 
ORO Oe @ 
re a—b a b—-a 


Combining these inequalities, we obtain f’(a) < f’(b). J 


Theorem | has two converses. Here the proofs will be a little more difficult. 
We begin with a lemma that plays the same role in the next theorem that Rolle’s 
Theorem plays in the proof of the Mean Value Theorem. It states that if f’ 
is increasing, then the graph of f lies below any secant line which happens to be 


horizontal. 


Suppose f is differentiable and f’ is increasing. If a < b and f(a) = f(b), then 


FQ) Sf@) = fosora—x <b 


Suppose that f(x) > f(a) = f(b) for some x in (a,b). Then the maximum of 
f on [a,b] occurs at some point xg in (a,b) with f(xo) => f(a) and, of course, 
f'(xo) = 0 (Figure 7). On the other hand, applying the Mean Value ‘Theorem to 


the interval [a, xo], we find that there is x; with a < x; < xg and 


_ fo) = f@ ~ 


xp —a 


f(xy) 0, 


contradicting the fact that f’ is increasing. § 


THEOREM 2 


PROOF 


(a, f(a)) 
a 


FIGURE 8 


THEOREM 3 


PROOF 
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We now attack the general case by the same sort of algebraic machinations that 
we used in the proof of the Mean Value ‘Theorem. 


If f is differentiable and f’ is increasing, then f is convex. 


Let a. <b. "Dehine ¢ by 


Ip 
ce) — 7 (ea) — pelea IE — a). 


b=6a 


It is easy to see that g’ is also increasing; moreover, g(a) = g(b) = f(a). Applying 
the lemma to g we conclude that 


Bis) = fla) it 


In other words, if a < x < b, then 


HO IE) 
b-a 


(ar 


f(x) - (x —a) < f(a) 


or 


F(x) — fla) 5 f(b) = Fla) 


x—-a b-a 


Hence f is convex. J 


If f is differentiable and the graph of f lies above each tangent line except at the 
point of contact, then f is convex. 


Let a <b. It is clear from Figure 8 that if (b, f(b)) les above the tangent line at 
(a, f(a)), and (a, f(a)) lies above the tangent line at (b, f(b)), then the slope of 
the tangent line at (b, f(b)) must be larger than the slope of the tangent line at 
(a, f(a)). The following argument just says this with equations. 

Since the tangent line at (a, f(a)) is the graph of the function 


oa Ga) (a). 
and since (b, f(b)) lies above the tangent line, we have 
Cy (Oy fh (ab — a) + f(a). 
Similarly, since the tangent line at (b, f(b)) is the graph of 
h(x) = f'(b)(x —b) + fb), 
and (a. f(a)) hes above the tangent line at (b, f(b)), we have 
(2) fla) > f'(b\(a—b) + f(b). 
It follows from (1) and (2) that f’(a) < f’(d). 


It now follows from Theorem 2 that f is convex. J 


Ifa function f has a reasonable second derivative, the mformation given in these 
theorems can be used to discover the regions in which f is convex or coucave. 
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Consider, for example, the function 


| 
For this function, 
"ej —= 
x) = ——.. 
(1 + x2)? 


Thus f’(x) = 0 only for x = 0, and f(O) = 1, while 


he), SOP ai ei! 
if (xe) 0 ah Se 0) 


Moreover, 


Tea) > 0 forall x; 
f(x) ~ 0 asx > coor -~, 
f is even. 


FIGURE 9 


The graph of f therefore looks something lke Figure 9. We now compute 


(eae earn PAU e se). sa) 


Js (1 + x2)4 


fi 2(3x2 — 1) 
mde x22 


It is not hard to determine the sign of f”(x). Note first that f”(«) = 0 only when 
x = /1/3 or —V/1/3. Since f” is clearly continuous, it must keep the same sign 
on each of the sets 


(—oo, —/ 1/3), 
(—V 1/3, V1/3), 
@uial/3; Go). 
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Since we easily compute, for example, that 


(Ct =m = 0 
f"() = -2 < 0, 
f"dy= 3>0, 


we conclude that 


i = Oroms(— oo, —./ 1/3) and G/1/3, co), 
fp = Con (—¥/ 173/173": 


Since f” > 0 means f’ is increasing, it follows from Theorem 2 that f is convex on 


(—o0, —/V 1/3) and (V 1/3, 00), while on (— J 1/3, V1/3) f is concave (Figure 10). 


f is convex f is concave f is convex 


a3 Pi 


FIGURE 10 


Notice that at (/ 1/3, 3) the tangent line les below the part of the graph to the 


right, since f is convex on (1/3, 00), and above the part of the graph to the left, 
since f is concave on (—/ 1/3, ¥ 1/3); thus the tangent line crosses the graph. In 


general, a number a 1s called an inflection point of / if the tangent line to the 


graph of f at (a, f(a)) crosses the graph; thus tS and ay are inflection 
points off (xy = 1/( x). Note that the condition f”(a) = O does not ensure 
that a is an inflection point of f; for example, if f(x) = xt, then f”(0) = 0, but 
f is convex, so the tangent line at (0, 0) certainly doesn’t cross the graph of f. In 
order to conclude that a is an inflection point of a function f/, we need to know 
that f” has different signs to the left and right of a. 


This example illustrates the procedure which may be used to analyze any func- 
tion f. After the graph has been sketched, using the information provided by /’, 
the zeros of f” are computed and the sign of f” is determined on the intervals 
between consecutive zeros. On intervals where f” > 0 the function is convex; 
on intervals where f” < 0 the function is concave. Knowledge of the regions of 
convexity and concavity of f can often prevent absurd misinterpretation of other 
data about f. Several functions, which can be analyzed in this way, are given in 
the problems, which also contain some theoretical questions. 
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‘Lo round out our discussion of convexity and concavity, we will prove one further 
result that you may already have begun to suspect. We have seen that convex and 
concave functions have the property that every tangent hne intersects the graph 
Just once; a few drawings will probably convince you that no other functions have 
this property, but the only proof I know is rather tricky. 


THEOREM 4 If f/f is differentiable on an interval and intersects each of its tangent lines just 
once, then f is either convex or concave on that interval. 


PROOF — ‘There are two parts to the proof. 

(1) First we claim that no straight line can intersect the graph of f in three different 

fo) points. Suppose, on the contrary, that some straight ne did intersect the graph 
of fratda. fC), f (@)) and (c, f(c)), witha < b < ec Tieure 11). Then we 

f(b) would have 

| (1) INO) a a a 

7) b—a c—a 

Consider the function 
— t ; Depr 
s ay (6) = te for x in [b,c]. 


Equation (1) says that g(b) = g(c). So by Rolle’s Theorem, there is some number x 
FIGURE 11 in (b,c) where 0 = g’(x), and thus 


0O= (x —a)f' (x) -—[fix) -— f@] 


or 
um sled Xp) cme Ge) 


jG SS (e! 


jee 


But this says (Figure 12) that the tangent hne at (x, f(¥)) passes through (a, f(a)), 
contradicting the hypotheses. 


(2) Suppose that ag < bg < cg and ay < by < cy are pomts in the interval. Let 


xX, = (1 —fthag + tay 
y = (1 —t)bo + 1th, 0 <% =<" 
eel = He aie 


FAs Re ety 


Then x9 = a9 and xy = ay and (Problem 4-2) the pomts x, all he between ao 
and ay, with analogous statements for y, and z;. Moreover, 


ee <i, <7; for Utes ga) - 


Now cousider the function 
fn) — f(x) 4 Fe) = wile) 


yrea Xt te eT 


a(n = forOter="- 


syistep (ly, .2(¢)! 4-OMfor allay 0 So.cither ¢(¢) > 0 tor all 7m (0, 1) on 
g(t) <0 for all 7 in [0, 1]. Thus, either f is convex or f is concave. J 
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PROBLEMS 


1. 


*6. 


ie 


Sketch, indicating regions of convexity and concavity and poimts of inflection, 
the functions in Problem | 1-1 (consider (iv) as double starred). 


Figure 30 m Chapter 11 shows the graph of f’. Sketch the graph of /f. 


Show that f is convex on an interval if and only if for all x and y in the 
interval we have 


f(tx+(h—ty) <tf@)+d-af(y). for0 <r <1. 
(This is just a restatement of the definition, but a useful one.) 


(a) Prove that if f and g are convex and f 1s increasing, then fog is convex. 
(It will be easiest to use Problem 3.) 

(b) Give an example where g o f is not convex. 

(c) Suppose that f and g are twice differentiable. Give another proof of the 
result of part (a) by considering second derivatives. 


(a) Suppose that f is differentiable and convex on an interval. Show that 
either f is increasing, or else f is decreasing, or else there is a number c 
such that f is decreasing to the left of ¢ and increasing to the right of c. 

(b) Use this fact to give another proof of the result in Problem 4(a) when f 
and g are (one-time) differentiable. (You will have to be a little careful 
when comparing f’(g(x)) and f’(g()) for x < y.) 

(c) Prove the result m part (a) without assuming f differentiable. You will 
have to keep track of several different cases, but no particularly clever 
ideas are needed. Begin by showing that if a < band f(a) < f(b), then 
f is increasing to the right of b; and if f(a) > f(b), then f is decreasing 
to the left of a. 


Let f be a twice-differentiable function with the following properties: 
fil@)e CO toreweer On, and fms idecreasine, ands /(G)o— Oy Proge shat 
f"(x) = 0 for some x > 0 (so that in reasonable cases f will have an inflec- 
tion point at x—an example is given by f(x) = 1/(1+x7)). Every hypothesis 
in this theorem is essential, as shown by f(x) = 1 — x7, which is not positive 
fOF ali ay. Pex) = x2, which is not decreasing; and by f(x) = I/(x + 1), 
which does not satisfy f’(0) = 0. Hint: Choose x9 > 0 with f’(x9) < 0. We 
cannot have f’(y) < f’(ao) for all y > x9. Why not? So f’(x1) > f’(xo) for 
some x; > X9. Consider f’ on [0, x1]. 


(a) Prove that if f is convex, then f([x + y]/2) <[f@)" f@)]/2. 

(b) Suppose that f satisfies this condition. Show that f(kx + (i —k)y) < 
kf (x) + (t —k) f(y) whenever & is a rational number, between 0 and 1, 
of the form m/2”,. Hint: Part (a) is the special case n = 1. Use induction, 
employing part (a) at each step. 

(c) Suppose that f satisfies the condition m part (a) and f is continuous. 
Show that f is convex. 
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H 
*8.  Forn > 1, let py,.... Px be positive numbers with ye (ime |. 


i 
n 


(a) kor any numbers x), ..., X, show that ws pix; hes between the smallest 


and the largest x;. i=l 
n-1 n—l 
(b) Show the same for (1/1) SS pki. wheres = Pi- 
fal i=l 
n H 
(c) Prove Jensen’s inequality: If f is convex, then f (> pa < Ss Pi f Gids 
Pinette ae bleniG note thal pe aaleys Par Gemetcdm toe 
n—-| 
that (1/t) yy Peoesin the domainot (if x), 4.-4 X47 0c.) 
i=l 


*9, (a) Forany function f, the right-hand derivative, jm, [ f(at+h)— f(a)|/h, is 


denoted by ime (a), and the left-hand derivative is denoted by f" (a). The 
proof of Theorem | actually shows that fj (a) and f! (a) always exist if 
f is convex on some open interval containing a. Check this assertion, 
and also show that f; and f! are increasing, and that f(a) < f{ (a). 

(b) Conversely, suppose that f 1s convex on [a, b] and g is convex on [b,c], 
with f(b) = g(b) and f'(b) < g'(b) (Figure 13(a)). If we define h 
on [a,c] to be f on [a,b] and g on [b,c], show that h is convex on 

g [a,c]. Hint: Given P and Q on opposite sides of O = (b, f(b)), as in 
Figure 13(b), compare the slope of OQ with that of PO. 

(c) Show that if f is convex, then f; (a) = f/(q@) if and only if f, is con- 
tinuous at a. (Thus f is differentiable precisely when f{ 1s continuous.) 
Hint: [f (6) — f(a)|/(b — a) 1s close to f’ (a) for b < a close to a, and 
f,(b) is less than this quotient. 


a b e *10. (a) Prove that a convex function on R, or on any open interval, must be 
continuous. 

(a) (b) Give an example of a convex function on a closed interval that is not 

continuous, and explain exactly what kinds of discontinuities are possible. 


11. Calla function f weakly convex on an interval if for a < b < cm this interval 
we have 
fOV= fla _— fO)—~ f@ 


x—-a " b—-—a 


(a) Show that a weakly convex function is convex if and only if its graph 
i : | contains no straight line segments. (Sometimes a weakly convex function 


a b c is sumply called “convex,” while convex functions in our sense are called 
(b) “strictly convex”’.) 
MCURE 13 (b) Reformulate the theorems of this section for weakly convex functions. 


12. 


13. 
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Find two convex functions f and g such that f(x) = g(x) if and only if x 
is an integer. Hint: First find an example where g is merely weakly convex, 
and then modify it, using the result of Problem 9 as a guide. 


A set A of points in the plane is called convex if A contains the line segment 
joining any two points in it (Figure 14). For a function f, let Ay be the set 
of points (x, y) with y > f(x), so that A, is the set of pomts on or above 
the graph of f. Show that Af is convex if and only if f is weakly convex, 
in the terminology of the previous problem. Further information on convex 
sets will be found in reference [18] of the Suggested Reading. 


(a) a convex subset of the plane (b) a non-convex subset of the plane 


FIGURE 14 


CHAPTER 


DEFINITION 


INVERSE FUNCTIONS 


We now have at our disposal quite powerful methods for investigating functions; 
what we lack is an adequate supply of functions to which these methods may 
be applied. We have studied various ways of forming new functions from old— 
addition, multiplication, division, and composition-—but using these alone, we can 
produce only the rational functions (even the sine function, although frequently 
used for examples, has never been defined). In the next few chapters we will 
begin to construct new functions in quite sophisticated ways, but there is one 
important method which will practically double the usefulness of any other method 
we discover. 

If we recall that a function is a collection of pairs of numbers, we might hit upon 
the bright idea of simply reversing all the pairs. Thus from the function 


f — bGe2y (ee 4), (&. 2), (13s 8) }, 


we obtain 


2= {Rl Gear Seria 


While #2 and: f(3) = 4, weshavese(2)s=aleand 34) — 3; 
Unfortunately, this bright idea does not always work. If 


f =10, 2), G4) 5S. 9, esas 


then the collection 


( (2, 1), Ge3)x Ops) seealia)y) 


is not a function at all, since it contams both (4,3) and (4, 13). It is clear where 
the trouble hes: f(3) = f(13), even though 3 4 13. This is the only sort of thing 
that can go wrong, and it is worthwhile giving a name to the functions for which 
this does not happen. 


A function f 1s one-one (read “one-to-one”) if f(a) # f(b) whenever a ¥ b. 


The identity function / is obviously one-one, and so is the followmg modifica- 


tion: 
x, Meee 
2) = (ae 
5m ae =" 


‘he funetion f(x) = x2 is not one-one, since f(-1) = fC), but if we define 
9 
eh) == x >0 


230 


DEFINITION 


THEOREM 1 


PROOF 


12. Inverse Functions 231 


(and leave g undefined for x < 0), then g is one-one, because g is increasing (since 
g'(x) = 2x > 0, for x > 0). This observation is easily generalized: If n is a natural 
number and 


[os See ul, 
then f is one-one. If n is odd, one can do better: the function 


hin x" for all x 


is one-one (since f’(x) = nx"—! > 0, for all x 4 0). 

It is particularly easy to decide from the graph of f whether f is one-one: the 
condition f(a) # f(b) for a 4 b means that no honzontal line intersects the graph 
of f twice (Figure 1). 


a one-one function a function that is not one-one 


(a) (b) 


FIGURE 1 


If we reverse all the pairs in (a not necessarily one-one function) f we obtain, in 
any case, some collection of pairs. It is popular to abstain from this procedure un- 
less f is one-one, but there is no particular reason to do so—instead of a definition 
with restrictive conditions we obtain a definition and a theorem. 


For any function f, the inverse of f, denoted by f~}, is the set of all pairs 


(a, b) for which the pair (6, a) is in f. 


f7' is a function if and only if f is one-one. 


Suppose first that f is one-one. Let (a,b) and (a,c) be two pairs in an. Then 
(b,a) and (c,a) are im f, soa = f(b) and a = f(c); since f is one-one this 
implies that b= c. Thus f~! is a function. 

Conversely, suppose that f7' is a function. If (6) = f(c), then f contains 
the pairs (b, f(b)) and (c, f(c)) = (c, f(b)), so (f(b), b) and (f(b), c) are in a 


Since f~! is a function this imphes that b = c. Thus f is one-one. ff 
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The graphs of f and f~! are so closely related that it is possible to use the 
eraph of f to visualize the graph of f~!. Since the graph of f~! consists of all 
pairs (a, b) with (b, a) in the graph of f, one obtains the graph of f—! from the 
graph of f by interchanging the horizontal and vertical axes. If f has the graph 
shown in Figure 2(a), 
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This procedure is awkward with books and impossible with blackboards, so it 1s 
fortunate that there is another way of constructing the graph of f~!. The points 
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(a,b) and (b,a) are reflections of each other through the graph of /(x) = x, 
which is called the diagonal (Figure 4). To obtain the graph of f~! we merely 
reflect the graph of f through this line (Figure 5). 


(a, b) 
e , 
of 
ve 
“y> 
_/diagonal 
Pa 
(aid) ez 
e Vie 
Re 
Ce e(b, a) 


FIGURE 4 FIGURE 5 


Reflecting through the diagonal twice will clearly leave us right back where we 
started: this means that (f~!)~! = f, which is also clear from the definition. In 
conjunction with ‘Theorem 1, this equation has a significant consequence: if f 
is a one-one function, then the function pau! is also one-one (since (yf alii is a 
function). 


There are a few other simple manipulations with inverse functions of which you 
should be aware. Since (a, b) 1s in f precisely when (b, a) is in (an it follows that 


b= f(a) means the same as w— 7 (bd). 


‘Thus ant (b) is the (unique) number a such that f(a) = b; for example, if f(x) = 
x? then i (b) is the umique number a such that a 3 = b, and this number is, by 
definition, Vb. 

The fact that f~!(x) is the number y such that f(y) = x can be restated in a 
much more compact form: 


folie) = for all x in the domam of f~ fr 


Moreover, 
foFQ) =x, for all x in the domain of f; 


this follows from the previous equation upon replacing f by f~!. These two 
important equations can be written 


a 
igo t 


(except that the right side will have a bigger domain if the domain of f or f~! is 


55 
not all of R). 
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FIGURE 6 


PUG URE a7 


THEOREM 2 


PROOF 


Since many standard functions will be defined as the inverses of other functions, 
it is quite mportant that we be able to tell which functions are one-one. We have 
already hinted which class of functions are most easily dealt with—increasing and 
decreasing functions are obviously one-one. Moreover, if f is mcreasing, then f—! 
is also increasing, and if f is decreasing, then f~! is decreasing (the proof is lefi 
to you). In addition, f is increasing if and only if —/f is decreasing, a very useful 
fact to remember. 

It is certainly not true that every one-one function is either mcreasing or decreas- 
ing. One example has already been mentioned, and is now graphed in Figure 6: 


xX; «3,9 
2(3) Se oy = 
Sly ooo 


Figure 7 shows that there are even continuous one-one functions which are neither 
increasing nor decreasing. But if you try drawing a few pictures you will soon 
suspect that every one-one continuous function defined on an interval is either 
increasing or decreasing. 


If f is contmuous and one-one on an interval, then f 1s either increasing or 
decreasing on that interval. 


‘The proof proceeds in three easy steps: 


(1) If a < b <c are three pomts mm the interval, then 


either (i) a@) = f(b) = 7 (c) 
or (ii) i@ = f(b) = 7 &). 


Suppose, for example, that f(a) < f(c). If we had f(b) < f(a) (Figure 8), then 
the Intermediate Value ‘Theorem applied to the interval [b, c] would give an x with 


FUG ESS 


b<x <cand f(x) = f(@), contradicting the fact that f is one-one on [a,c]. 
Sunilarly, f(b) > f(c) would lead to a contradiction, so f(a) < f(b) < f(c). 


Naturally, the same sort of argument works for the case f(a) > f(c). 


(2) If a<b<c <d are four pomts in the interval, then 


either (i) f(a) = f(b) = fle) = fila) 
or (ii) ia) > [) = fia] fa: 


For we can apply (1) toa <b <c and then to b <e <d. 


FIGURE 9 
a 
y 
T©) 
a 


FIGURE 10 


& 


THEOREM 3 


PROOF 
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(3) ‘Take any a < b in the interval, and suppose that f(a) < f(b). Then f is 
increasing: For if c and d are any two points, we can apply (2) to the collection 
{a, b,c, d} (after arranging them in increasing order). J 


Henceforth we shall be concerned almost exclusively with continuous increasing 
or decreasing functions which are defined on an interval. If f is such a function, 
it is possible to say quite precisely what the domain of f~! will be like. 

Suppose first that f is a continuous increasing function on the closed interval 
[a,b]. Then, by the Intermediate Value Theorem, f takes on every value between 
f(a) and f(b). Therefore, the domain of fae is the closed interval [ f(a), f(b). 
Similarly, if f is continuous and decreasing on [a,b], then the domain of f~! is 
[ f(b), fla)). 

If f is a continuous increasing function on an open interval (a,b) the analysis 
becomes a bit more difficult. To begin with, let us choose some point c in (a, b). 
We will first decide which values > f(c) are taken on by f. One possibility is that 
f takes on arbitrarily large values (Figure 9). In this case f takes on all values 
> fic), by the Intermediate Value Theorem. If, on the other hand, f does not 
take on arbitrarily large values, then A = { f(x): ¢ < x < b} is bounded above, 
so A has a least upper bound @ (Figure 10). Now suppose y is any number with 
f(c) < y < a. Then f takes on some value f(x) > y (because a is the least 
upper bound of A). By the Intermediate Value Theorem, f actually takes on 
the value y. Notice that f cannot take on the value a itself; for if a = f(x) for 
a <x <band we choose ¢ with x <¢t < b, then f(t) > a, which is impossible. 

Precisely the same arguments work for values less than f(c): either f takes on 
all values less than f(c) or there is a number B < f(c) such that f takes on all 
values between B and f(c), but not £ itself: 

This entire argument can be repeated if f is decreasing, and if the domain of f 
is R or (a,00) or (—o0, a). Summarizing: if f is a continuous increasing, or 
decreasing, function whose domain is an interval having one of the forms (a,b), 
(—oo, b), (a, 00), or R, then the domain of f~! is also an interval which has one 
of these four forms, and we can easily fit the remaining types of intervals, (a, b], 
la, b], (—c, b], and [a, oo), into this discussion also. 

Now that we have completed this preliminary analysis of continuous one-one 
functions, it is possible to begin asking which important properties of a one-one 
function are inherited by its inverse. For continuity there is no problem. 


If f is continuous and one-one on an interval, then f~! is also continuous. 


We know by Theorem 2 that f is either increasing or decreasing. We might as 
well assume that /f is increasing, since we can then take care of the other case by 
applying the usual trick of considering — f. We might as well assume our interval 
is Open, since it Is easy to see that a continuous increasing or decreasing function 
on any interval can be extended to one on a larger open interval. 

We must show that 


lim f-'a) = f-') 


xb 
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f(a)+6 


fta)=8 


MERONIs, WN 


(f(a). a)y = 


LiZ De 


PG Res 12 


for each b in the domain of f~!. Such a number db is of the form f(a) for some a 
in the domain of f. For any ¢ > 0, we want to find a 6 > O such that, for all x, 


if f(a) -—5 <x < f(a)+4, thena—e < Gen) <a+t+é. 


Figure 11 suggests the way of finding 6 (remember that by looking sideways you 
see the graph of f~!): since 


a-—-€E<a<at+eé, 


it follows that 
fla—e) < f(a) < flate); 


we let 6 be the smaller of f(a+e)— f(a) and f(a)— f(a—e). Figure 11 contains 
the entire proof that this 6 works, and what follows is simply a verbal account of 
the information contained in this picture. 

Our choice of 5 ensures that 


f(a —e&) < f(a)—Sand f(a) +6 < flat+e). 


Consequently, if 
fla)-é6 <x < f(a)t+6, 


then 
jQ—) 2a <ifila- ec). 


Since f is increasing, f~! is also increasing, and we obtain 


ag (a — ey (X) << Waa tee 


es 
a) 
a—-ée<f (x)<a+teé, 


which is precisely what we want. 


Having successfully investigated continuity of f~!, it is only reasonable to tackle 
differentiability. Again, a picture indicates just what result ought to be true. Fig- 
ure 12 shows the graph of a one-one function f with a tangent line L through 
(a. f(a)). If this entre picture is reflected through the diagonal, it shows the graph 
of yea) and the tangent line L’ through (f(a), a). ‘The slope of L’ is the reciprocal 
of the slope of L. In other words, it appears that 


I 
Sinek 
Cr OY = 
, f'(a) 
This formula can equally well be written in a way which expresses (f-')'t) ci- 
rectly, for each b in the domain of gical 


s— Ih. 
(f-')() = —————. 
J ue wa MD) 


Unlike the argument for continuity, this pictorial “proof” becomes somewhat 
involved when formulated analytically. ‘Vhere is another approach which might 


PU GIReE IS 


 — 
THEOREM 4 
PROOF 
PO ONES 
(b) 
THEOREM 5 
PROOF 
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be tried. Since we know that 


FSI) =x, 
it is tempting to prove the desired formula by applying the Chain Rule: 
fF TO) (FY) = 1, 
SO 
| , < 

CO) ae a 
a) 
Unfortunately, this is not a proof that f~! is differentiable, since the Chain Rule 
cannot be applied unless f~! is already known to be differentiable. But this argu- 


ment does show what (f~!)’(x) will have to be if f~! is differentiable, and it can 
also be used to obtain some important preliminary information. 


If f is a continuous one-one function defined on an interval and _f’(f~!(a)) = 0, 
then f~! is not differentiable at a. 


We have 
GE Ea) = 
If f~! were differentiable at a, the Chain Rule would imply that 


FG mr Vor 


hence 


0-(f-!)'(@) =1, 


which is absurd. J 


A simple example to which Theorem 4 applies is the function f(x) = x?. Since 
f'(0) =0 and 0 = f~!(0), the function f~! is not differentiable at 0 (Figure 13). 

Having decided where an inverse function cannot be differentiable, we are now 
ready for the rigorous proof that in all other cases the derivative is given by the 
formula which we have already “derived” in two different ways. Notice that the 
following argument uses continuity of f~', which we have already proved. 


Let f be a continuous one-one function defined on an interval, and suppose that 
f is differentiable at f~!(b), with derivative f’(f~'(b)) 4 0. Then f7! is differ- 
entiable at b, and 


ao =. 
i (D) f'(f(b)) 


Cee —ywita). ken 


fae hh) f(b) 
ql :ne EEE 
hO h 

. f'O+h-G 
= lim SSS 
h—-0 h 
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Now every number b +h in the domain of f~! can be written in the form 
b+h= f(at+k) 


for a unique k (we should really write k(h), but we will stick with k for simplicity). 


Then 


O42) =e 
lim — SS 
h—O h 
oo haa) =e 
= lim $$ 
h>0 fla+k)—b 
k 


= lm —_____.. 
h>0 f(a+k) — f(a) 


We are clearly on the right track! It is not hard to get an explicit expression for k; 
since 


b+h= f(a+k) 


we have 
f '@+h)=atk 
or 


k= fa Oct) =f 40), 


Now by Theorem 3, the function f—! is continuous at b. This means that k 
approaches 0 as h approaches 0. Since 


i; flat+k) — fla) 
>), SSS 


ee ay pS 
k0 i =fi@m=f Ff ©) 49, 


this imphes that 


l 
(f-')(b) = ———_.. 
a Gime) ' 


The work we have done on inverse functions will be amply repaid later, but here 
is an immediate dividend. For n odd, let 


f(x) =x" forvallizs: 


for n even, let 


Ti i= aer, Pe Uy 
Then f, is a continuous one-one function, whose inverse function 1s 


Bn (x) = Vx = x1!" 
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By Theorem 5 we have, for x # 0, 


2n %) = FaGae eo) 


l 

n( fn "(x)" 
| 
n(x1/n)jn-l 
] 
= ll , x A/n-1 
n 

Thus, if f(x) = x“, and a is an integer or the reciprocal of a natural number, then 
f(x) = ax*"!. It is now easy to check that this formula is true if a is any rational 
number: Let a = m/n, where m 1s an integer, and n is a natural number; if 


HE) = xm/n = (2). 


then, by the Chain Rule, 


| 7 
no) Sle) tes iS 


= a . x Len/n)—(/n)]+[ A /n)— 1] 
n 


= mM (m/n)-1 
n 
Although we now have a formula for f’(x) when f(x) = x“ and a 1s rational, 
the treatment of the function f(x) = x® for irrational a will have to be saved 
for later——at the moment we do not even know the meaning of a symbol like x2, 
Actually, inverse functions will be involved crucially in the definition of x“ for 
irrational a. Indeed, in the next few chapters several important functions will be 


defined in terms of their inverse functions. 


PROBLEMS 
1. Find f~! for each of the following f. 
FG = eee 


i) ft@\— (1) 
oi Xe x rational 
es | —x, Xx irrational. 
te - — x2 Gs 
Ps | =a 2 0. 
% anaes Gn 
(Vi aiGai—eoree—iay tS 1s ts 


“ily eee 
(vi) f(x) =x-+ [x]. 
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10. 


11. 
“oh: 
13. 


(vil) f(O.aja2a3...) = O.a2a)a3.... (Decimal representation is bemg used.) 


(yi) 7 —s =e ay <l, 
x2 


= 
Describe the graph of f~! when 
1) (fis increasing and always positive. 


(1) fis increasing and always negative. 
(ii) f is decreasing and always positive. 


wv) ff is decreasing and always negative. 


Prove that if f is increasing, then so is f~!, and similarly for decreasing 
functions. 


If_f and g are increasing, is f + g? Or f-g? Or fog? 


(a) Prove that if f and g are one-one, then f o g is also one-one. Find 


(f og)! in terms of f7! and g7~!. Hint: The answer is not f7~! 0 g7!. 
(b) Find g~! in terms of f7! if g(v) =1+4 f(x). 
x+b es - % 
Show that f(x) = are is one-one if and only if ad — be ¥ 0, and find 
cx +¢ 


f7! in this case. 
On which intervals [a,b] will the following functions be one-one? 


(Gi) Ca) = 0° — 3x2. 
(u) gee Goes sae begs 
(tie! Gael) x2) oe 


' wee tl 
iy f= 


Suppose that f is differentiable with derivative f’(x) = (1 + x3)7!/2, Show 
(hat 2 = yee Sauisties 2° (x) = 5a (x)?. 


Suppose that f is a one-one function and that f~! has a derivative which is 
nowhere 0. Prove that f is differentiable. Hint: There is a one-step proof. 


As a follow up to Problem 10-17, what additional condition on g will insure 
that f is differentiable? 


Find a formula for a Ca. 
Prove that if f’(f7'(4)) 4 Oand f(f7!(x)) exists, then (f7!) (x) exists. 
The Schwarzian derivative & f was defined in Problem 10-19. 


(a) Prove that if G f(x) exists for all x, then G f~!(x) also exists for all x in 
the domain of f—!. 
(Ib) Find a formula for Df “ley. 
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*14, (a) Prove that there is a differentiable function f such that [f(x)]? + f(x) + 
x = 0 for all x. Hint: Show that f ean be expressed as an inverse 
function. The easiest way to do this is to find f~'. And the easiest way 
to do this is to set x = f7!(y). 

(b) Find f’ in terms of f, using an appropriate theorem of this chapter. 
(e) Find f’ in another way, by simply differentiating the equation defining f. 


The funetion in Problem 14 is often said to be defined implicitly by the 
equation y>+y+x = 0. The situation for this equation is quite special, however. As 
the next problem shows, an equation does not usually define a function implicitly 
on the whole line, and in some regions more than one function may be defined 
implicitly. 


15. (a) What are the two differentiable functions f which are defined imphcitly 
on (—1, 1) by the equation x*+y? = 1, ie., which satisfy x?+[f(x)]? = 1 
for all x in (—1, 1)? Notice that there are no solutions defined outside 
[Sal U. 

(b) Which functions f satisfy x* + [f (x)]? =—-1? 
*(c) Which differentiable functions f satisfy [f(x)]* — 3 f(x) = x? Hint: It 
will help to first draw the graph of the function g(x) = x? — 3x. 


In general, determining on what intervals a differentiable function is defined im- 
plicitly by a particular equation may be a delicate affair, and is best diseussed in the 
context of advanced caleulus. If we assume that f is such a diflerentiable solution, 
however, then a formula for f’(x) can be derived, exactly as im Problem 14(c), by 
differentiating both sides of the equation defining f (a proeess known as “implicit 
clifferentiation’): 


16. (a) Apply this method to the equation [ f(x)]? + x7 = 1. Notice that your 
answer will involve f(x); this is only to be expected, since there is more 
than one function defined implicitly by the equation y? + x7 = 1. 
(b) But check that your answer works for both of the functions f found in 
Problem 15(a). 
(ec) Apply this same method to [f(x)]* — 3f(@) = x. 


17. (a) Use implicit differentiation to find f’(x) and f”(x) for the functions f 
defined implicitly by the equation x7 + y? = 7. 
(b) One of these functions f satisfies f(—1) = 2. Find f’(—1) and f’(-1) 
for this f. 


18. The colleetion of all points (x, y) sueh that 3x3 + 4x7y — xy? + 2y3 = 4 
forms a eertain curve in the plane. Find the equation of the tangent line to 
this curve at the point (—1, 1). 


19. Leibnizian notation is particularly convenient for implicit differentiation. Be- 
cause y is so consistently used as an abbreviation for f(x), the equation mx 
and y which defines f implicitly will automatically stand for the equation 
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20. 


21; 


a. 


25. 


P24. 


which f is supposed to satisfy. How would the following computation be 
written in our notation? 


ne As y> + xy elf 


3dy xdy dy 
By a ep ee 
dx a” dx _s dx 

dy —y 


dx 4y343y24x- 


4) 


As long as Leibnizian notation has entered the picture, the Leibnizian no- 
tation for derivatives of inverse functions should be mentioned. If dy/dx 
denotes the derivative of f, then the derivative of f~! is denoted by dx/dy. 
Write out Theorem 5 in this notation. The resulting equation will show you 
another reason why Leibnizian notation has such a large following. It will 
also explain at which point (f~!)’ is to be calculated when using the dx /dy 
notation. What is the significance of the followmg computation? 


n 


w= ye 
y en 
ax!" = (ln 
dx dx dx gyn 
dy 


ct 


Suppose that f is a differentiable one-one function with a nowhere zero 
derivative and that f = F’. Let G(x) = xf~!(x) — F(f~'(x)). Prove that 
G'(x) = f-!(x). (Disregarding details, this problem tells us a very interesting 
fact: if we know a function whose derivative is f, then we also know one 
whose derivative is f~!. But how could anyone ever guess the function G? 
‘Two different ways are outlined in Problems 14-14 and 19-16.) 


Suppose /i is a function such that h’(x) = sin? (sin (x + 1)) and A(O) = 3. 
lind 


1) (Gy 
il) (B-')'(3), where B(x) = h(x + 1). 


( 

( 

(a) Prove that an increasing and a decreasing function imtersect at most once. 

(b) Find two continuous increasing functions f and g such that f(v) = g(x) 
precisely when x is an integer. 

(c) Find a continuous increasing function f and a continuous decreasing 

function g, defined on R, which do not intersect at all. 


(a) If f is a continuous function on R and f = f~!, prove that there is at 
least one x such that f(*) = x. (What does the condition f = f~'! mean 
gcometrically?) 

(b) Give several examples of continuous f such that f = f-' and f@) =% 
for exactly one x. Hint: ‘Try decreasing f, and remember the geometric 
interpretation. One possibility is f(v¥) = —x. 


#2). 


26. 


wae 


12. Inverse Functions 243 


(c) Prove that if f is an increasing function such that f = f7!, then 


f(x) = x for all x. Hint: Although the geometric interpretation will 
be immediately convincing, the simplest proof (about 2 lines) is to rule 
out the possibilities f(x) < x and f(x) > x. 


Which functions have the property that the graph is still the graph of a func- 
tion when reflected through the graph of —/ (the “antidiagonal”)? 


A function f is nondecreasing if f(x) < f(y) whenever x < y. (To be 
more precise we should stipulate that the domain of f be an interval.) A 
nonincreasing function is defined similarly. Caution: Some writers use 
“increasing” instead of “nondecreasing,” and “strictly increasing” for our 
“increasing, ” 


(a) Prove that if f is nondecreasing, but not increasing, then f is constant 
on some interval. (Beware of unintentional puns: “not increasing” is not 
the same as “nonincreasing,’”’) 

(b) Prove that if f is differentiable and nondecreasing, then f’(x) > O for 
ellie 

(c) Prove that if f’(x) = 0 for all x, then f is nondecreasing, 


(a) Suppose that f(x) > O for all x, and that f is decreasing. Prove that 
there is a continuous decreasing function g such that 0 < g(x) < f(x) for 
all x. 

(b) Show that we can even arrange that g will satisfy dim wor (x= 0. 
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APPENDIX. PARAMETRIC REPRESENTATION OF CURVES 


The material in this chapter serves to emphasize something that we noticed a 
long ume ago—a perfectly nice looking curve need not be the graph of a function 
(Figure 1). In other words, we may not be able to describe it as the set of all points 
(x, f(x)). Of course, we might be able to describe the curve as the set of all poimts 
(f(x),x); for example, the curve mn Figure | is the set of all pots (x2, x). But 
even this trick doesn’t work in most cases. It won’t allow us to describe the circle, 
consisting of all points (x, y) with x? + y? = I, or an ellipse, and it can’t be used 
to describe a curve like the one in Figure 2. 


The simplest way of describing curves m the plane m general harks back to the 
FIGURE 1 physical conception of a curve as the path of a particle moving in the plane. At 
each time f, the particle is at a certain point, which has two coordinates; to indicate 
the dependence of these coordmates on the time f, we can cal] them u(t) and v(t). 
Thus, we end up with &@o functions. Conversely, given two functions u and v, we 
can consider the curve consisting of all points (u(t), v(t)). This curve is said to 
be represented parametrcally by u and v, and the pair of functions u, v is called a 
parametric representation of the curve. The curve represented parametrically by 
u and v thus consists of all pairs (x, y) with x = u(t) and y = v(t). It is often 
described briefly as “the curve x = u(t), y = v(t).” Notice that the graph ofa 
function f can always be described parametrically, as the curve x =f, y = f(t). 
Instead of considering a curve in the plane as defined by two functions, we 
can obtain a conceptually simpler picture if we broaden our original definition of 
function somewhat. Instead of considering a rule which associates a number with 
another number, we can consider a “function ¢ from real numbers to the plane,” 
FIGURE 2 1e., a rule c that associates, to each number f, a point in the plane, which we can 
denote by c(t). With this notion, a curve is just a function from some interval of 
real numbers to the plane. 
Of course, these two different descriptions of a curve are essentially the same: 
A pair of (ordinary) functions u and v determines a single function c from the real 
numbers to the plane by the rule 


CO) = CT) Vie 


and, conversely, given a function ¢ from the real numbers to the plane, each c(t) 
is a point m the plane, so it 1s a pair of numbers, which we can call u(t) and v(t), 
so that we have unique functions w and v satisfying this equation. 
In Appendix 1 to Chapter 4, we used the term “vector” to describe a pomt in 
the plane. In conformity with this usage, a curve in the plane may also be called 
e(t) a “vector-valued function.” The conventions of that Appendix would lead us to 
write c(t) = (cy (t), C27), but m this Appendix we'll continue to use notation like 
— = — c(t) = (u(t), v(t)) to mmimize the use of subscripts. 


A simple example of a vector-valued function that is quite useful ts 


e(t) = (cost, sin/), 


FIGURE 3 which goes round and round the unit circle (Figure 3). 


FIGURE 4 
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For two (ordinary) functions f and g, we defined new functions f+ g and f-g 
by the rules 


(1) (fj sya) — 7 OO) ee). 
(2) (f -g)(x) = f(x): g(x). 


Since we have defined a way of adding vectors, we can imitate the first of these def- 
initions for vector-valued functions c and d: we define the vector-valued function 
Gedy, 


(err = Gil) od (a) 


where the + on the right-hand side is now the sum of vectors. his simply amounts 
to saying that if 


GU p= (HE), UM), 
J@)yS(w(r), za), 


then 
(c+d)(t) = (u(t), v(t)) + (w(t), z(t) = (u(r) + w(t), v(t) + z(t). 


Recall that we have also defined a -v for a number a and a vector v. To 
extend this to vector-valued functions, we want to consider an ordinary fuiction a 
and a vector-valued function c, so that for each t we have a number a(t) and a 
vector c(t). Then we can define a new vector-valued function @ - ¢ by 


(a-c)(t) =a(t)- c(t), 


where the - on the right-hand side is the product of a number and a vector. This 
simply amounts to saying that 


(a: c)@) S017) Gee 0) = (a(1) u(t), a(t) > v(t). 
Notice that the curve @ - e, 
(a-e)(t) = (a(t) cost, a(t)sintr), 


is already quite general (Figure 4). In the notation of Appendix 3 to Chapter 4, 
the point (@-e)(t) has polar coordinates @(t) and f, so that (@-e)(t) is the “graph 
of @ in polar coordinates.” 
Even more generally, given any vector-valued function c, we can define new 
functions r and 6 by 
c(t) =r(t)- e(@(t)), 


where r(t) 1s just the distance from the origin to c(t), and @(t) is some choice of 
the angle of c(r) (as usual, the function @ isn’t defined unambiguously, so one has 
to be careful when using this way of writing an arbitrary curve c). 

We aren't in a position to extend (2) to vector-valued functions m general, since 
we haven't defined the product of two vectors. However, Problems 2 and 4 of 
Appendix | to Chapter 4 define two real-valued products v + w and det(v, w). It 
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FIGWIRE 5 


cla +h) 


should be clear, given vector-valued functions c and d, how we would define two 
ordinary (real-valued) functions 


cea and det(c, d). 
Beyond imitating simple arithmetic operations on functions, we can consider 
more interesting problems, like limits. For c(t) = (u(t), v(t)), we can define 


(*) linac lima (2¢ (t), v(t)) tobe (tim u(t), lim v(0)) ; 
> =a t 


ta we 


Rules like 
linc +d = lunc + limd, 


sa = a ia 

lina -c = lma(t)- lime 

t>a >a t>a 
follow immediately. Problem 10 shows how to give an equivalent definition that 
umitates the basic definition of limits directly. 


Limits lead us of course to derivatives. For 
c(t) = (u(t), v@)) 
we can define c’ by the straightforward definition 
c'(a) = (u'(a), v'(a)). 
We could also try to imitate the basic definition: 
P . ce(a+th) —cla) 
c (a) = im —————_,, 
h-0 h 


where the fraction on the right-hand side is understood to mean 
| . 
rl (c(i) cg) |) 
1 


As a matter of fact, these two definitions are equivalent, because 


. eC(ath) —c(a) ; ula th)—ula) vlat+th) — v(a) 
laa AA. = Lim. (| SS _., A 


h-0 h ho0 hh h 


. ulath)—ula) .. vlath)—v(a) 
= [| lm ——__,, hn,-:~X A 


h>0 h h—0 h 
by our definition (*) of limits 
= (w(a)au ay 


Figure 5 shows c(a + /2) and c(a), as well as the arrow from c(a) to c(a +h); 
as we showed in Appendix | to Chapter 4, this arrow is c(a +h) — c(a), except 
moved over so that it starts at c(a). As h = 0, this arrow would appear to move 
closer and closer to the tangent of our curve, so it seems reasonable to define the 
tangent line of ¢ at c(a) to be the straight line along c’(a), when c’(a) 1s moved 
over so that it starts at c(a). In other words, we define the tangent line of ¢ at c(a) 
as the set of all points 


c(a) +s -c'(a): 


12, Appendix. Parametric Representation of Curves 247 


for s = O we get the point c(a) itself, for s = 1 we get c(a) + c’(a), etc. (Note, 
however, that this definiton does not make sense when c’(a) = (0, 0).) Problem | 
shows that this definition agrees with the old one when our curve c is defined by 


Cu) = (0, fi), 
so that we simply have the graph of /f. 
Once again, various old formulas have analogues. For example, 
(c +d) (a) =c'(a)+d'(a), 
(a -c) (a) = @ (a) - c(a) + a(a) - c'(a), 
or, as equations involving functions, 
(Cd) —re as 
(a-c) =a'-ct+a-c. 
These formulas can be derived immediately from the definition in terms of the 
component functions. They can also be derived from the definition as a limit, 
by imitating previous proofs; for the second, we would of course use the standard 
trick of writing 
a(a+h)c(a+h)—ala)c(a) = 
a(a+h)-[ce(a +h) —c(a)| + [e(@+h) —a(a)]-c(a). 
We can also consider the function 
d(t) =c(p(t)) = (co p)(t), 


where p is now an ordinary function, from numbers to numbers. ‘The new curve d 
passes through the same points as c, except at different times; thus p corresponds 
to a “reparameterization” of c. For 


c=(u, v), 
d= ec, vo p), 


we obtain 


d'(a) = ((u o py'(a), (vo p)y'(a)) 
= (p'(a)u'(p(a)). p'(ayv'(p(a))) 
= p'(a): (u'(p(a)). v'(p(a))) 
= p (@)-c'(p(a)), 


or simply 
G7 e(@4o p). 


Notice that if p(a) = a, so that d and ¢ actually pass through the same point at 
time a, then d’(a) = p’(a)-c’(a). so that the tangent vector d’(a) is just a multiple 
of c'(a). This means that the tangent /ine to c at c(a) is the same as the tangent 
line to the reparameterized curve d at d(a) = c(a). The one exception occurs 
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when p’(a) = Q, since the tangent line for d is then undefined, even though the 
tangent line for c may be defined. For example, d(r) = c(t?) won't have a tangent 
line defined at ¢ = 0, even though it’s merely a reparameterization of c. 

Finally, since we can define real-valued functions 


(car) (ah = c(t) - diay 
det(crait) = det(c(t), aia), 


we ought to have formulas for the derivatives of these new functions. As you might 
guess, the proper formulas are 


(c-d)'(a) =c(a)-d'(a)+c'(a)-d(a), 
[det(c, d)|/(a) = det(c’, d)(a) + det(c, d’)(a). 


These can be derived by straightforward calculations from the definitions in terms 
of the component functions. But it is more elegant to imitate the proof of the or- 
dinary product rule, using the simple formulas in Problems 2 and 4 of Appendix 1 
to Chapter 4, and, of course, the “standard trick” referred to above. 


PROBLEMS 


I. (a) Fora function f, the “poit-slope form” (Problem 4-6) of the tangent 
line at (a, f(a)) can be written as y — f(a) = (x — a) f’(a), so that the 
tangent line consists of all points of the form 


(x, f(a) + (x —a) f(a). 
Conclude that the tangent line consists of all points of the form 
(a +s, f(a) + ST @)l 


(b) If cis the curve c(t) = (t, f(t)), conclude that the tangent line of c¢ at 
(a, f(a)) [using our new definition] is the same as the tangent line of f 


at-(a, | (@)): 


2, let aW) = {fie 17), where f is the function shown in Figure 21 of Chap- 
ter 9. Show that ¢ hes along the graph of the non-differentiable function 
h(x) = |x|, but that c’(0) = (0, 0). In other words, a reparameterization can 
“hide” a corner. For this reason, we are usually only interested in curves ¢ 
with c’ never equal to (0, 0). 


3. Suppose that x = w(t), y = v(t) is a parametric representation of a curve, 
and that uw is one-one on some interval. 


(a) Show that on this interval the curve lies along the graph of f = vou7!, 


(b) If wis differentiable on this interval and w(t) 4 O, show that at the point 
x = H(t) we have 


FIGURE 6 


P 
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In Leibnizian notation this is often written suggestively as 


dy 
dy dt 
dx dx 
dt 


(c) We also have 
u'(t)v”(t) — v'(t)u’(t) 
(fo) 


Consider a function f defined implicitly by the equation «7 + y?/? = 1. 
Compute f’(x) in two ways: 


‘ps (x) = 


@) By implicit differentiation. 


(ii) By considering the parametric representation x = cos’, y = sin’ ft. 


Let x = u(t), y = v(t) be the parametric representation of a curve, with 
u and v differentiable, and let P = (xo, yo) be a point in the plane. Prove 
that if the point Q = (u(t), v(t)) on the curve is closest to (x9, yo), and u’(7) 
and v’(t) are not both 0, then the line from P to Q is perpendicular to the 
tangent line of the curve at Q (Figure 6). The same result holds if Q is 
furthest from (x9, yo). 


We've seen that the “graph of f in polar coordinates” is the curve 


Ca-e)() = Gf @) cosé fF) sins); 


in other words, the graph of f in polar coordinates is the curve with the para- 
metric representation 


6. 


ba— / (0) cose? y= f (0) suve: 


(a) Show that for the graph of f in polar coordinates the slope of the tangent 
line at the point with polar coordinates (f (6), 4) is 


— f (0) sin 0 + f'(0) cos@ 


(b) Show that if f(@) = O and f is differentiable at 6, then the line through 
the origin making an angle of 6 with the positive horizontal axis is a 
tangent line of the graph of f in polar coordinates. Use this result to 
add some details to the graph of the Archimedean spiral in Appendix 3 
of Chapter 4, and to the graphs in Problems 3 and 10 of that Appendix 
as well. 

(c) Suppose that the point with polar coordinates (f(@), @) is further from 
the origin O than any other point on the graph of f. What can you 
say about the tangent line to the graph at this point? Compare with 
Problem 5. 
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FIGURE 


(d) 


Suppose that the tangent line to the graph of f at the point with po- 
lar coordinates (f(@),@) makes an angle of @ with the horizontal axis 
(Figure 7), so that a — @ is the angle between the tangent line and the 
ray from O to the point. Show that 


ff) 

oO). 

In Problem 8 of Appendix 3 to Chapter 4 we found that the cardioid 
r = | —sin@ 1s also described by the equation cgay) ae 


tanta —@) = 


Find the slope of the tangent line at a point on the cardioid in two ways: 
(i) By implicit differentiation. 
(ii) By using the previous problem. 
Check that at the origin the tangent lines are vertical, as they appear to 
be in Figure 8. 


FIGURE 8 


The next problem uses the material from Chapter 15, m particular, radian 


measure, and the inverse trigonometric functions and their properties. 


8. A cycloid is defined as the path traced out by a point on the rim of a rolling 
wheel of radius a. You can see a beautiful cycloid by pasting a reflector on 


the edge of a bicycle wheel and having a friend ride slowly in front of the 


headlights of your car at night. Lacking a ear, bicycle, or trusting friend, you 


can settle mstead for Figure 9. 


IGA RSS 


FIGURE 10 


length at 
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(a) Let u(t) and v(t) be the coordinates of the point on the rim after the 
wheel has rotated through an angle of ¢ (radians). This means that the 
arc of the wheel rim from P to Q in Figure 10 has length at. Since the 
wheel is rolling, at is also the distance from O to Q. Show that we have 
the paramctric represcntation of the cycloid 


u(t) =a(t —sint) 
v(t) = a(1 —cos?r). 


Figure 1] shows the curves we obtain if the distance from the point to the 
center of the wheel is (a) less than the radius or (b) greater than the radius. 
In the latter case, the curve is not the graph of a function; at certain times 
the point is moving backwards, even though the wheel is moving forwards! 


(b) 


PUGU RES 


In Figure 9 we drew the cycloid as the graph of a function, but we really 
need to check that this is the case: 


(b) Compute w/(t) and conclude that u is increasing. Problem 3 then shows 
that the cycloid is the graph of f = vou7!, and allows us to compute 
f'(t). 


(c) Show that the tangent lines of the cycloid at the “vertices” are vertical. 
It isn’t possible to get an explicit formula for f, but we can come close. 


(d) Show that 


— (ft 
u(t) =a arccos ae 4 Vail. 


a 


Hint: first solve for tf in terms of u(t). 
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NG rURs hae 


10. 


1 


(ec) The first half of the first arch of the cycloid is the graph of g~', where 


— J(2a — y)y. 


Let uw and v be continuous on [a,b] and differentiable on (a,b); then u 


—_ ) 


2 (= a arceos 
a 


and v give a parametric representation of a curve from P = (u(a), v(a)) 
to Q = (u(b), v(b)). Geometrically, it seems clear (Figure 12) that at some 
point on the curve the tangent line is parallel to the lme segment from P 
to Q. Prove this analytically. Hint: This problem will give a geometric 
interpretation for one of the theorems in Chapter 11. You will also need to 
assume that we don’t have u(x) = v’(x) = O for any x in (a,b) (compare 
Problem 2). 


The following definition of a limit for a vector-valued function is the direct 
analogue of the definition for ordinary functions: 


lim c(t) = 7 means that for every ¢ > 0 there is some 6 > O such that, for 
te 


all r, if O < |r —a| < 4, then ||c(t) —1|| < «. 


Here || || is the norm, defined in Problem 2 of Appendix | to Chapter 4. If 
j= (/), 6) hen 


let) — A? = Jus) — PF + [v() — bP. 


(a) Conclude that 
ju(t) — Ny] < fet) — ZI and |u(t) — /g| = lle) — Af, 


and show that if lim c(t) =/ according to the above definition, then we 
: 


nalts 


also have 


lim u(t) =1, and lim v(t) = bh, 


fa t—a 


so that lim c(t) =/ according to our definition (*) in terms of component 
; : 


Sit! 
functions, on page 246. 
(b) Conversely, show that if lim c(t) =/ according to the definition in terms 
{>a 


of component functions, then also lim c(t) = / according to the above 
: 


Sal 


definition. 


(a, Q) 


JUG ABUSE, Il 


CHAPTER 


(b, 0) 


INGORE, 2 


FIGURE 3 


INTEGRALS 


The derivative does not display its full strength until allied with the “integral,” the 
second main concept of Part III. At first this topic may seem to be a complete 
digression— in this chapter derivatives do not appear even once! The study of 
integrals does require a long preparation, but once this preliminary work has been 
completed, integrals will be an invaluable tool for creating new functions, and the 
derivative will reappear m Chapter 14, more powerful than ever. 

Although ultimately to be defined in a quite complicated way, the integral for- 
malizes a simple, intuitive concept that of area. By now it should come as 
no surprise to learn that the definition of an intuitive concept can present great 
difficulties —“area” is certainly no exception. 

In elementary geometry, formulas are derived for the areas of many plane fig- 
ures, but a little reflection shows that an acceptable definition of area is seldom 
given. ‘The area of a region is sometimes defined as the number of squares, with 
sides of length 1, which fit in the region. But this definition is hopelessly inadequate 
for any but the simplest regions. For example, a circle of radius | supposedly has 
as area the irrational number z, but it is not at all clear what “z squares” means. 
Even if we consider a circle of radius 1/2. which supposedly has area 1, it is hard 
to say in what way a unit square fits m this circle, since it does not seem possible 
to divide the unit square into pieces which can be arranged to form a circle. 

In this chapter we will only try to define the area of some very special regions 
(Figure 1)}—those which are bounded by the horizontal axis, the vertical lines 
through (a,0) and (b,0), and the graph of a function f such that f(x) > 0 
for all x in [a, b]. It is convenient to indicate this region by R(f, a. b). Notice that 
these regions include rectangles and triangles, as well as many other important 
geometric figures. 

The number which we will eventually assign as the area of R(f,a,b) will be 
called the integral of f on [a,b]. Actually, the integral will be defined even for 
functions f which do not satisfy the condition f(x) > O for all x in [a,b]. If f is 
the function graphed in Figure 2, the integral will represent the difference of the 
area of the hghtly shaded region and the area of the heavily shaded region (the 
“algebraic area” of RC f. a, b)). 

The idea behind the prospective definition is indicated in Figure 3. ‘The interval 
[a, b] has been divided into four subintervals 


[tos fil itis to) [fasta Sita. ea] 
by means of numbers fo, f1, f2, 8, 4 with 
Gai) — ln <p =< elyee 


(the numbering of the subscripts begins with O so that the largest subscript will 
equal the number of subintervals). 


pAS SS) 


Zot 
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DEFINITION 


DEFINITION 


On the first terval [f, t)| the function f has the mmimum value my, and the 
maximum value M,; similarly, on the 7th interval [4—1, ¢;] let the minimum value 
of f be m; and let the maximum value be M;. The sum 


Ss = my(t) — to) + m2(t2 — 1) +:113(% — t2) ting (ty — &3) 


represents the total area of rectangles lying inside the region R(f, a,b), while the 
sum 


S = Mi Gresto). + Male — h) + M36 = Dea — 8) 


represents the total area of rectangles contaiming the region R(f, a,b). The guid- 
ing principle of our attempt to define the area A of R(f, a,b) is the observation 
that A should satisfy 

c< Awan A <5. 


and that this should be true, 70 matter how the interval [a, b| is subdivided. It is to be 
hoped that these requirements will determine A. The following definitions begin 
to formalize, and eliminate some of the implicit assumptions in, this discussion. 


Let a < b. A partition of the interval [a, | is a finite collection of poimts in 


[a,b], one of which is a, and one of which ts b. 


The pomts in a partition can be numbered f0, ..., fr so that 
i \esedin <= - -: <olpe ie iy Se 


we shall always assume that such a numbering has been assigned. 


Suppose f is bounded on [a,b] and P = {f,....t} is a partition of [a,b]. Let 


Wee il jax) 1 Soe a}, 
NG SO COM Me es eS 


The lower sum of f for P, denoted by L(f. P), is defined as 


n 


L(fP) = So milt if 3a 10) 


ic! 


The upper sum of f for P, denoted by U(f, P), is defined as 


U(f, P) = 0 Milti — f-1). 


I 


The lower and upper sums correspond to the sums s and S in the previous 
example; they are supposed to represent the total areas of rectangles lying below 
and above the graph of f. Notice, however, that despite the geometric motivation, 
these sums have been defined precisely without any appeal to a concept of “area.” 


FIGURE 4 


IEG) GR) Oye) 


LEMMA 


PROOF 
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Two details of the definition deserve comment. ‘The requirement that f be 
bounded on [a. b] is essential in order that all the m; and M; be defined. Note, 
also, that it was necessary to define the numbers mm; and M; as inf’s and sup’s, 
rather than as minima and maxima, since f was not assumed continuous. 

One thing is clear about lower and upper sums: If P is any partition, then 


EO Foclee UA), Ee), 


because 


n 


Lif, Py= Yo milt aren) 


= 


Uf, P) =) Milt — &-1), 


j=l 


and for each 7 we have 
ie Oe ae 1). 


On the other hand, something less obvious ought to be true: If P; and P are 
any two partitions of [a,b], then it should be the case that 


D6 we) SKF 


because L(f, P)) should Bege=earearn@ 7740)5 anasU( f, Ps) shouldiber—saraa 

R(f, a,b). This remark proves nothing (since the “area of R(f, a, b)” has not even 
been defined yet), but it does indicate that if there 1s to be any hope of defining the 
area of R(f.a.b), a proof that L(f, P|) < UCf, Po) should come first. The proof 
which we are about to give depends upon a lemma which concerns the behavior of 
lower and upper sums when more points are included in a partition. In Figure 4 
the partition P contains the points in black, and Q contains both the points in 
black and the poimts in grey. The picture indicates that the rectangles drawn for 
the partition Q are a better approximation to the region R(f. a. b) than those for 
the original partition P. ‘To be precise: 


If Q contains P (1.e., if all points of P are also in Q), then 


eee) = Lf 0), 
jee) = ULF, O). 


Consider first the special case (Figure 5) in which Q contains just one more point 
than P: 


where 


a9 = t= = hey et, = 0, 


256 Derivatwes and Integrals 


THEOREM 1 


Let 


hin = wil { f(x) > tel) Se 
= inl Xk) oe = i = eee 


~ 

~ 

~ 
= 


Then 
i 


iG — So milt ==). 


=| 
k-] Nn 

EGO) = So mit —t 1) tm’ (ua — 1) tin" (h — a) + y my (t; — t)-1). 
il i=k+1 


To prove that L(f, P) < L(f, Q) it therefore suffices to show that 
im. (th — te) < m' (wu — th_)) Ean (me — KB). 


Now the.set {f@): 4 = x < %) Contains allMhe numbers in{7 (x) 7,7 = 
x <u}, and possibly some smaller ones, so the greatest lower bound of the first set 
is less than or equal to the greatest lower bound of the second; thus 


my <a. 


Similarly, 


Pik exe tle - 
Therefore, 
ni (te — t.1) = ee — &e1) Hind, ow) < ie — th) +m" (& — @). 


This proves, in this special case, that L(f, P) < L(f, Q). The proofthat U(f, P) = 
U(f, Q) is similar, and is left to you as an easy, but valuable, exercise. 

The general case can now be deduced quite easily. ‘The partition Q can be 
obtained from P by adding one point at a time; in other words, there is a sequence 
of partitions 


ao Pe. Prk OC 
such that P)4) contains just one more point than Pj. ‘Then 
EC, P) = EG Lf. ip) => = Lf, fa) — "Li O), 


and 
UG, P) = U Garin Ff. Px) = --- SU GPS aean 


The theorem we wish to prove is a simple consequence of this lemma. 


Let Pj and Py be partitions of [a,b], and let f be a function which is bounded 
on [a,b]. Then 
AG ies CROCE Te py, 


a= t) tb 


FIGURE 6 
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There is a partition P which contains both P; and P3 (let P consist of all points 
in both P; and Pz). According to the lemma, 


Lae yi aeleee) =U, P) = UG, Pal 


It follows from Theorem | that any upper sum U(/. P’) is an upper bound for 
the set of all lower sums L(f, P). Consequently, any upper sum U (f, P’) is greater 
than or equal to the east upper bound of all lower sums: 


sup(L(fmP) : 2 a partition of [arbiia<— UO @& RAs 


for every P’. This, in turn, means that sup{L(f, P)} is a lower bound for the set 
of all upper sums of f. Consequently, 


sup, Py = miu CP )). 


It is clear that both of these numbers are between the lower sum and upper sum 
of f for all partitions: 


LG, P’) <sapl LG, Py} eee P’), 
LP) = mt (Og, Bey = UF, 2), 


for all partitions P’. 
It may well happen that 


Sip) {| Og fae = mieh (fF. P}; 


in this case, this 1s the only number between the lower sum and upper sum of f 
for all partitions, and this number is consequently an ideal candidate for the area 


of R(f,a.b). On the other hand, if 
sup{L(f, P)} < inf (UCL, PY}, 
then every number x between sup{L(f, P)} and inf {U(f, P)} will satisfy 
LGge = =U, P} 


for all partitions P’. 

It is not at all clear just when such an embarrassment of riches will occur. The 
following two examples, although not as teresting as many which will soon ap- 
pear, show that both phenomena are possible. 

Suppose first that f(~) = ¢ toma in |@,b] (Figure 6). If P = {%p,..., fis 
any partition of [a,b], then 

na M; = c. 
so 
n 
L(f, P) =) ci = 4-1) =eb — a). 
il 
Ht 
Uf. P) = > c(t — 4-1) =c(b— a). 


i=] 
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In this case, all lower sums and upper sums are equal, and 
supiL(/, P)} = wifi ce = a). 
Now consider (Figure 7) the function f defined by 


: QO, x irrational 
f(x) = 


|. x Fational. 


If P= {io .. s@}is any partition, then 


m; = 0, since there is an irrational number in [#-1. &], 


and 


Seccccccccocooce 


a= t th et = M; = 1, since there is a rational number in [f-1, t]. 


FIGURE7 ‘Therefore, 


Lf, P) = 90+ (i — 4-1) = 0, 


|| 


HW 
Uf. P) = 01-G-h-) = ba. 
i=l 
Thus, in this case it is certainly noé true that sup{L(f, P)} = nf {UCf, P)}. The 
principle upon which the definition of area was to be based provides insufficient 
information to determine a specific area for R(f,a,b)--any number between 0 
and b — a seems equally good. On the other hand, the region R(f, a,b) is so 
weird that we might with justice refuse to assign it any area at all. In fact, we can 
maintain, more generally, that whenever 


supiLcf, Py Ami (Og) 


the region R(f,a, 6) is too unreasonable to deserve having an area. As our ap- 
peal to the word “unreasonable” suggests, we are about to cloak our ignorance m 
terminology. 


DEFINITION A function f which is bounded on [a, b] is integrable on [a,b] if 
sup{L(f, P) : P a partition of [a, b]} = mf{U(f, P): P a partition of [a, b]}. 


In this case, this common number 1s called the integral of f on [a,b] and is 
denoted by 


a 
(The symbol f is called an integral sign and was originally an elongated s, for 
“sum;” the numbers a and b are called the lower and upper limits of integration.) 


‘The integral iP f is also called the area of R(f, a,b) when f(x) = 0 for all x 
m [a,b]. 


THEOREM 2 


PROOF 
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If f is integrable, then according to this definition, 


b 
B(QR I) Ss / i =U, FP) tor allipanutions ? ot |a, bi). 


a 


“b . : : 3 
Moreover, ff is the waique number with this property. 

‘This definition merely pinpoimts, and does not solve, the problem discussed 
before: we do not know which functions are integrable (nor do we know how to 
find the integral of f on [a,b] when f is integrable). At present we know only 
two examples: 


b 
(1) if f(x) =c, then f is mtegrable on [a, b] and 7 = (Db —a), 


a 


(Notice that this integral assigns the expected area to a rectangle.) 


Q, x irrational 
1, x rational, 


C2) eae (x then f is not integrable on [a, Db}. 


Several more examples will be given before discussing these problems further. 
Even for these examples, however, it helps to have the following simple criterion 
for integrability stated explicitly. 


If f is bounded on [a,b], then f is mtegrable on [a,b] if and only if for every 
€ > 0 there 1s a partition P of [a,b] such that 


MG) UG) 


Suppose first that for every ¢ > O there is a partition P with 
U GP) LU VP) 
Since 


int (UN (SB) ae ee. 
SUP I sel ull ye Ey aes 


it follows that 
inftiUiGe eo siplile., BP) <x 


Since this is true for all ¢ > Q, it follows that 
Sup sGLUe TL init Chae yy 


by definition, then, f 1s integrable. ‘The proof of the converse assertion is similar: 
If f is mtegrable, then 


sup glC sey) — mil) UNG Pole 
‘This means that for each ¢ > 0 there are partitions P’, P” with 


Wh P’) SRG!) << 
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Let P be a partition which contains both P’ and P”. Then, according to the 
lemma, 


EE, TO) SUG. 
Ce eG 


consequently, 


Cer) 2, ae Ge eG ee 


Although the mechanics of the proof take up a httle space, it should be clear 
that Theorem 2 amounts to nothing more than a restatement of the definition 
of integrability. Nevertheless, it is a very convenient restatement because there is 
no mention of sup’s and inf’s, which are often difficult to work with. ‘The next 
example illustrates this point, and also serves as a good introduction to the type 
of reasoning which the complicated definition of the integral necessitates, even m 
very simple situations. 


Let f be defined on [0, 2] by 


| 0, ek el 
CoE he ooe— Oe 
Suppose P — (io aaeee !,} is a partition of [O, 2] with 


Pe l <1j 


(see Figure 8). Then 
nm; = MM, = Os Fa, 


but 
og ll) and M; =1. 
Since 
ie ! 
Lif, P= So mili —t)-1) tinj(tj — Goa) + yy, 1 iwc 1) 
jal al 


j-l N 
Uf. P) = 0 Mili — 4-1) + My — 4-1 + | Mili — 0). 
i=l i=j+l 


we have 


ON. Pye LF P) = Ga. 
This certainly shows that f is mtegrable: to obtain a partition P with 
UGG ae LO Pe, 
it is only necessary to choose a parution with 
jo < 1 wy; Baie | Say Te Se 
Moreover, it 1s clear that 


Lif, P)=O0=8 U(f.R2) forathparihons: 
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Since f is integrable, there is only one number between all lower and upper sums, 


namely, the integral of f, so 
2 
(0 
0 


Although the discontinuity of f was responsible for the difficulties in this exam- 
ple, even worse problems arise for very simple continuous functions. For example, 
let f(x) = x, and for simplicity consider an interval [0,5], where b > 0. If 
| Zales) aaa t,} 1s a partition of [0, b], then (Figure 9) 


a and M; =t; 


and therefore 
EGP) = > 1G i) 
=i 
= fo (Ci — 10) sia ae at Gl Ge — a) 


OG, P= iG 
i=] 


= f(t) — 1) Fin =f) aes ee a = 


FIGURE 9 Neither of these formulas is particularly appealing, but both simplify considerably 
for partitions P, = {1,...., tn} into n equal subintervals. In this case, the length 
t; — t;_, of each subinterval is b/n, so 
to = 0, 
b 
i=-, 
n 
2b 
LD — =.) ClG 
n 


in general 
i — 


Then 


AG, 2) = ti a) 


7 


-> {I b 
Mi n n 
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FIGURE 10 


Remembering the formula 


_ kk +1) 


{ess aa 
foe 5 


this can be written 


(n—1)(n) b2 


GRD Na ra 


Sunilarly, 


KS Pa) => — a) 
—N 


i— 


2 n2 


If n is very large, both L(f, P,) and U(f, P,,) are close to IPD. and this remark 
makes it easy to show that f 1s integrable. Notice first that 
2 


CiGe ea LAS, P,) == 5 
n 2 


This shows that there are partitions P, with U(f, P,)—L(f, Pn) as small as desired. 
By Theorem 2 the function f is integrable. Moreover, iF f may now be found 
with only a little work. It is clear, first of all, that 


p) 


b 
KG EV) Di =U(j, 2) forall: 


This inequality shows only that b?/2 lies between certain special upper and lower 
sums, but we have just seen that U(f, P,,) — L(f, P,) can be made as small as 
desired, so there 1s only one number with this property. Since the integral certainly 
has this property, we can conclude that 


b f 2 b2 
On De 


. . . . 9 . . . . 
Notice that this equation assigns area b/2 to a right triangle with base and alti- 
tude b (Figure 10). Using more involved calculations, or appealing to ‘Theorem 4, 


it can be shown that 
i f b2 az 
ay Z 2: 


FIGURE 11 
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The function f(x) = x? presents even greater difficulties. In this case (Fig- 
ure 11), if P = {f,...,t,} 1s a partition of [0, b], then 


m=fG0=G1)> and M=/@)=%°. 


Choosing, once again, a partition P, = {fo,..., t,} into n equal parts, so that 


the lower and upper sums become 


EGE P,) = We: (t A ti-1) 


I 


Recalling the formula 
P+ +k? = tk(k + DQk + 1) 


from Problem 2-1, these sums can be written as 


b> 1 

L(f, Pn) = = - s(n — 1)(n)(2n - 1), 
n> 6 
be i 

UG, En) =a Ot + DM) On 1): 
n> 6 


It is not too hard to show that 
b3 
LG Es) < a) = Uf, eas 


and that U(f, P,) — L(f, P,) can be made as small as desired, by choosing n 
sufficiently large. ‘The same sort of reasoning as before then shows that 

b b3 

oe ey 
This calculation already represents a nontrivial result—the area of the region 
bounded by a parabola is not usually derived in elementary geometry. Never- 
theless, the result was known to Archimedes, who derived it in essentially the same 
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way. ‘The only superiority we can claim is that in the next chapter we will discover 
a much simpler way to arrive at this result. 
Some of our investigations can be summarized as follows: 


b 
7=c8o-—a if  fO)=—ciforallx. 


y nee , 
ary if f(x) =~ forall x, 
b b3 3 
= ~ a = if f(x) =x? forall x. 


memo. 79 é sb 0 
Vhis list already reveals that the notation J, f suffers from the lack ofa convenient 
notation for naming functions defined by formulas. For this reason an alternative 
notation,* analogous to the notation hm f(x), 1s also useful: 


X= 4 


b b 
f(x)dx means precisely the same as | re 


a a 


b 
/ G@adx =¢> (b= a), 
[ F be a? 
ide -—, 
‘ z 


a 
b ¢ b 3 
x°dx =—~—-—. 
[ eas 3 3 


Notice that, as in the notation lim f(x), the symbol x can be replaced by any 


Ate 


other letter (except f, a, or b, of course): 


‘Thus 


b 


a ¢ 


b b b b 
Hous = ih) ae = / f(a)da= Oe = / Fic yae. 


a 


The symbol dx has no meaning in isolation, any more than the symbol x. —> 
has any meaning, except in the context lim f(x). In the equation 


x7a 


i ooeeae, ae 
: x qx= 5 


*'The notation ie f(x) dx is actually the older, and was for many years the only, symbol for the 
integral. Leibniz used this symbol because he considered the integral to be the sum (denoted by f) 
of infinitely many rectangles with height f(x) and “infinitely smalF’ width dx. Later writers used 
XQ.+++,4n to denote the points of a partition, and abbreviated x; —.xj—, by Ax;. The integral was 
W 
defined as the limit as Ax; approaches 0 of the sums SS f (xj) Ax; (analogous to lower and upper 
iil 
sums). ‘The fact that the limit is obtained by changing 3 to f, f(xy) to f(x), and Ax; to dx, delights 
many people. 
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. ay . . 
the entire symbol x- dx may be regarded as an abbreviation for: 
. r 9) 
thestimctions such that f(@) = x- for all ax: 


This notation for the integral is as flexible as the notation lim f(x). Several ex- 


xa 
amples may aid in the interpretation of various types of formulas which frequently 
appear; we have made use of Theorems 5 and 6.* 


b b b b2 az 
(1) (x+ y)dx = / x dx + ib ai — ake oa + y(b—a). 
a : 4 * s < 
te ge 
(2) i (y+tthdy= / ydy +/ nd eo is +t(x —a). 


b x b 
(3) if (/ (1 + ds) Goa (l+r)(x —a)dx 


b 
= +n f (x —a)dx 


y 


i D2 eG i 
=(1l+1r) a OO 
b d b d2 C2 
(4) / (| (x + y) ay) dx= if x(d—c)+ a dx 
a c a fe a 
da ¢? b 
= Biss (b—a)+(d—- of ax 
a . b2 a? 
= aE (b—a)+(d—c) im 2 


The computations of f, : xdx and f{ x? dx may suggest that evaluating integrals 
is generally difficult or impossible. As a matter of fact, the integrals of most func- 
tions ave impossible to determine exactly (although they may be computed to any degree 
of accuracy desired by calculating lower and upper sums). Nevertheless, as we shall see in 
the next chapter, the integral of many functions can be computed very easily. 

Even though most integrals cannot be computed exactly, it is important at least 
to know when a function f 7s integrable on [a,b]. Although it is possible to say 
precisely which functions are integrable, the criterion for integrability is a litde too 
difficult to be stated here, and we will have to settle for partial results. The next 
Theorem gives the most useful result, but the proof given here uses material from 
the Appendix to Chapter 8. If you prefer, you can wait until the end of the next 
chapter, when a totally different proof will be given. 


* Lest chaos overtake the reader when consulting other books, equation (1) requires an mportant 

qualification. ‘his equation interprets te ydx to mean the integral of the function f such that each 
eres : ; : 2 ob : 

value f(x) 1s the number y. But classical notation often uses y for y(v), so {7 ydx might mean the 

integral of some arbitrary function y. 
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THEOREM 3 


PROOF 


If f is continuous on [a,b], then f is integrable on [a, b]. 


Notice, first, that f is bounded on [a,b], because it is continuous on [a,b]. To 
prove that f is integrable on [a,b], we want to use Theorem 2, and show that for 
every € > 0 there is a partition P of [a,b] such that 


Ui f= LkeP) 
Now we know, by Theorem | of the Appendix to Chapter 8, that f is uniformly 
continuous on [a,b]. So there is some 6 > O such that for all x and y in [a, b], 


flx—y 6, the x)— . ——_—., 
if |x — y| < yen | f(x) OU ra 


The trick is simply to choose a partition P = {to,...,¢:} such that each |t; —4;_-1| < 
6. Then for each i we have 
; € : 
| f(x) — fQy)| < —— for alley inter fe 
2(b—a) 
and it follows easily that 
E E 
M, -—m,; < ———- < 


2 pea 


Since this 1s true for all 7, we then have 


U(f, P) — Lf, P) = ) (Mi — mi (te — 1) 


i=l 
WH 
€ 
<a Sot 
b-a‘+ 
i=] 
Vs 
== -b—a 
ba 
=e. 


which is what we wanted. J 


Although this theorem will provide all the information necessary for the use of 
integrals in this book, it is more satisfying to have a somewhat larger supply of 
integrable functions. Several problems treat this question in detail. It will help to 
know the following three theorems, which show that f is integrable on [a,b], if it 
is integrable on [a,c] and [c, b]; that f + g is integrable if f and g are; and that 
c+ f is integrable if f is mtegrable and c¢ is any number. 

As a simple application of these theorems, recall that if f 1s 0 except at one 
point, where its value is 1, then f is mtegrable. Multiplying this function by c, it 
follows that the same is true if the value of f at the exceptional point is c. Adding 
such a function to an integrable function, we see that the value of an integrable 
function may be changed arbitrarily at one pomt without destroying mtegrability. 

sy breaking up the mterval into many subintervals, we see that the value can be 
changed at finitely many points. 

The proofs of these theorems usually use the alternative criterion for integrability 
in Theorem 2; as some of our previous demonstrations illustrate, the details of the 


IU WORT, 2 


THEOREM 4 


PROOF 
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argument often conspire to obscure the poimt of the proof. It is a good idea to 
attempt proofs of your own, consulting those given here as a last resort, or as a 
check. This will probably clarify the proofs, and will certainly give good practice 
in the techniques used in some of the problems. 


Leta <c <b. If f is integrable on [a, b], then f is integrable on [a,c] and on 
[c. b]. Conversely, if f is integrable on [a,c] and on [c, b], then f is integrable 
on [a,b]. Finally, if f is integrable on [a, b], then 


frafrrfie 


Suppose f is integrable on [a, b]. If e > 0, there is a partition P = {to,..., tr} of 
[a,b] such that 
EG PO EB We a Gi pee 22 ea 


We might as well assume that c = ¢; for some j. (Otherwise, let Q be the partition 


which contains fo,.... i; anc’ g@ then O cémtams@P, so U(f, OQ) — L(UJ, Q) = 
Of, PL, Bie ee 
INow IP’ = {ipa (;) isea partition ob \a@,cleaud (2 — (in... t,} 1s a partition 


ofc. 6] Ficure 12) since 


Le) = Lo eee oe 
Ger) —UGaP) 1 UGLr ), 


we have 
[UCP > LSP EL Cae Lge UR Fy LR) ae 
Since each of the terms in brackets is nonnegative, each is less than ¢. ‘This shows 


that f is integrable on [a,c] and [c, b]. Note also that 


LP) sf fs ucs.Py, 


a 


b 
Lipeys ff <uys.r’, 


so that 


G b 
Wy gia) ies i oe ME Om ENE 


Since this is true for any P, this proves that 


c b b 
gay 


Now suppose that f is integrable on [a,c] and on [c, b]. If ¢ > 0, there is a 
partiton P’ of [a,c] and a partition P” of [c, b] such that 
Ge ea oe Pca]. 
a Pi) —wac se, P”) < oe 
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THEOREM 5 


PROOF 


If P is the partition of [a,b] containing all the points of P’ and P”, then 


Lik = LU fae eee ee), 
UG Pe Ch, Py eae 


consequently, 


CRS f(y =| ey Posen P ) — Lif P| = 2] 


Theorem 4 is the basis for some minor notational conventions. The integral 


(Boye . 2 ayo 
f{, f was defined only for a < b. We now add the definitions 


a b a 
fi io and i f ila>b. 
a b 


a 


r us _ c bp _ cb SM , 
With these definitions, the equation fF u ae 7 te fe f holds for all a, c, b even 
if a <c < bis not true (the proof of this assertion is a rather tedious case-by-case 


check). 


If f and g are integrable on [a,b], then f + g 1s integrable on [a,b] and 


b b b 
/ +e | r+ oe 
a a a 


Let P = ign. 2, ibe any partition of I'a~]. Let 


mm, = mi{(f gee) a) = dal, 
Hit; = lithalpie( Secale | eal) 
in; = nl (2(x) Sey = ae 


and define M;, M;’, M;” similarly. It is not necessarily true that 
m; =m; +m,;”, 

but it 1s true (Problem 10) that 
m, >m, +m,”. 


Sunilarly, 
M; < M;'+M,". 
‘Therefore, 
bes) + L(g, & a seb feceageeh ) 


and 
C@ 8. fF) = UG) a (ee. 


Thus, 
L(f, P) + L(g eC et P) SUS oi ee): 
Since f and g are integrable, there are partitions P’, P” with 


Ce Lae Cie a2: 
Cg ce ee Ae 


THEOREM 6 


PROOF 
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If P contains both P’ and P”, then 
OG 2a) Ue) =e ee oi) ee, 


and consequently 


This proves that f + g is mtegrable on [a,b]. Moreover, 
(1) ECF oP) in Sie ye = LA freee 
b 
<| (f + 8) 
=U (j +8, P) = U (jar, Hae 
and also 
b b 
(2) LOR) + ile. rvs | f+ f 8 SPU (EP tae): 


Since U(f, P) — L(f, P) and U(g, P) — L(g, P) can both be made as small as 
desired, it follows that 


OR emo ee) OG rhea 


can also be made as small as desired; it therefore follows from (1) and (2) that 


b b b 
s+e= | f+ gl 


If f is mtegrable on [a,b], then for any number c, the function cf is mtegrable 


b b 
| Se ; 


The proof (which is much easier than that of Theorem 5) is left to you. It is a good 
idea to treat separately the cases c > 0 and c < 0. Why? f 


on [a,b] and 


(Theorem 6 is just a special case of the more general theorem that f + g is 
integrable on [a,b], if f and g are, but this result 1s quite hard to prove (see 


Problem 38).) 


In this chapter we have acquired only one complicated definition, a few simple 
theorems with mtricate proofs, and one theorem which required material from the 
Appendix to Chapter 8. This is not because integrals constitute a more difficult 
topic than derivatives, but because powerful tools developed in previous chapters 
have been allowed to remain dormant. The most significant discovery of calculus 
is the fact that the mtegral and the derivative are mtmmately related—once we 
learn the connection, the integral will become as useful as the derivative, and as 
easy to use, The connection between derivatives and integrals deserves a separate 
chapter, but the preparations which we will make in this chapter may serve as a 
hint. We first state a simple mequality concerning integrals, which plays a role in 
many important theorems. 
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FAG Reeth 


THEOREM 7 


PROOF 


area 


Fic +h) — F(c) 


THEOREM 8 


PROOF 


Suppose f is integrable on [a,b] and that 
m < f(x) <M for all x in [a, bd}. 
Then : 
m(b —a) <| f <M(b-a). 


It is clear that 
ui — a= L( f, Pa vand iG. Py) = (Ga) 


for every partition P. Since 1B f Sssupte GP) = mite Gg. P)}. he desired 
inequality follows immediately. §f 


Suppose now that /f is integrable on [a,b]. We can define a new function f on 


[a, b| by . | 
F(x) =| iy =P (ayaa. 


(This depends on Theorem 4.) We have seen that f may be mtegrable even if it 
is not continuous, and the Problems give examples of mtegrable functions which 
are quite pathological. The behavior of F is therefore a very pleasant surprise. 


If f is integrable on [a,b] and F is defined on [a,b] by 


8) es 
a 


Suppose c is in [a,b]. Since f is integrable on [a, b] it is, by definition, bounded 


then F is continuous on [a, b]. 


on [a,b]; let M be a number such that 
Lf(x)| < M for all x in [a, b). 
if h > 0, then (Figure 13) 


cth (é cth 
Fic+h)— Feo) = | r-for=] if 


—M < f(x) <M for all x, 


Since 


it follows from ‘Theorem 7 that 
cth 
—-M-h< / f <Mh; 
in other words, 
el —-M-h< F(cth)—Fle) <M -h. 


If h <0, a similar mequality can be derived: Note that 


oth c 
Fic) — Fo = | sa-| f. 
Jc cth 
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Applying Theorem 7 to the interval [c + h, c], of length —h, we obtain 


multiplying by —1, which reverses all the inequalities, we have 
(2) Mh < F(c +h) — F(c) < —Mh. 
Inequalities (1) and (2) can be combined: 
[(@-e)— F(e) |= Mel. 
Therefore, if ¢ > 0, we have 
|F(c +h) — F(c)| <e, 
provided that |h| < ¢/M. This proves that 


lim F(e= hi). =F (e): 
h> 


in other words F is continuous at c. § 


Figure 14 compares f and F(x) = J” f for various functions f; it appears 


os 


ee 
a 
i F 

a 


cra 


F 
a 
a F 
F 
lj 
FIGURE 14 
— ie a iee 


that F is always better behaved than f. In the next chapter we will see how true 
ih 
eo—- 
1 


this is. 
a LJ 
—_ 
a 
if 
IL 
C 
| 


a 


272 Derivatives and Integrals 


PROBLEMS 


| ; ; ae ; ; 
1. Prove that fy x3dx = b*/4, by considering partitions into 2 equal subin- 
H 


: 5 3 3 ; £ ; eae 

tervals, using the formula for ) i” which was found in Problem 2-6. ‘This 
i=] 

problem requires only a straightforward imitation of calculations in the text, 

but you should write it up as a formal proof to make certain that all the fine 

points of the argument are clear. 


2. Prove, similarly, that is x4 dx = b° WSs 
H 
*3. (a) Using Problem 2-7, show that the sum SS kP {nP*! can be made as close 
=I 
to 1/(p + 1) as desired, by choosing n large enough. 
(b) Prove that % xP dx = bP*!/(p + 1)" 


b 
*4, ‘This problem outlines a clever way to find / x? ax for 0 <sdu< ses (ellie 
a 
result for a = 0 will then follow by continuity.) ‘The trick is to use partitions 
P = {to,e.., {Mor which all rafies r = t;/t;2; are“equal, imstead’ of using 
0 i 1 S 
partitions for which all differences ¢; — f;-; are equal. 
(a) Show that for such a partition P we have 
: b 
ij =a-ci!" ele — 
a 


(b) If f(x) =+?, show, using the formula m Problem 2-5, that 


iH 
U(f, P) =a - clr) ee) 
i=l 
—1/ 
= Ge = peel sre ee ‘i 
7 1 — clpt)/n 


] 
| i els aT yy al 


and find a similar formula for L(f. P). 
(c) Conclude that 


(pet! _ aPtlyep/n : 


b ppt! ss q?ti 
x! dx = ————_——.. 
a pa 


(You might find Problem 5-41 useful.) 


5. Evaluate without domg any computations: 


] 
(1) / won) | — ie he 
l 
] 
(11) / (x? +18 aaa 
—! 


6. 
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Prove that 


ie sin t ee 
0 t+ 1 


for all <x S30. 


Decide which of the following functions are integrable on [0, 2], and calculate 
the integral when you can. 


(v1) 


x. Oa I 
oe Pm: 
Be Oper =! 
ca) ee l= a 2: 
f@) =x + [x]. 
, | xt+[x], ~x rational 
fax) = | 0. x irrational. 


71 . | Le oof the forma + bV2 for rational a and b 
eo 
QO, x not of this form. 


at Owe x a1 


f@)= =| 


0, ei oreo =. 


(vil) f is the function shown in Figure 15. 


FIGURE 15 


Find the areas of the regions bounded by 


5 


the graphs of f(x) = x? and eC) > + 2. 


the graphs of f(x) = x? and g(x) = —x? and the vertical lines through 
(—1, 0) and (1, 0). 

the graphs of f(x) = x? and g(x) =1— x2. 

the graphs of f(x) = x? and g(x)=1- x? and (AC) — 

the graphs of f(x) = x? and g(x) = x* — 2x + 4 and the vertical axis. 
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10. 


11. 


12: 


13. 


14. 


(vi) the eraph of f(x) = Vx, the horizontal axis, and the vertical line 
2 

through (2,0). (Don't try to find / Vx dx; you should see a way of 
0 


guessing the answer, using only integrals that you already know how to 
evaluate. The questions that this example should suggest are consiclered 
in Problem 21.) 


ind 


b d 
i (| Foseray) dx 


5 Des od aan 8 : a nm : ; 
in terms of f; f and f° g. (Chis problem is an exercise in notation, with a 


vengeance; it is crucial that you recognize a constant when it appears.) 
Prove, using the notation of Theorem 5, that 
f . ~ 
m; +m,” = inl { f(x) + e(x2) 2 1) < X1.x2 < th} <j. 


(a) Which functions have the property that every lower sum equals every 
upper sum? 

(b) Which functions have the property that some upper sum equals some 
(other) lower sum? 

(c) Which continuous functions have the property that all lower sums are 
equal? 


*(d) Which integrable functions have the property that all lower sums are 


equal? (Bear in mind that one such function is f (+) = 0 for x irrational, 
FQ) Sal] tor x ="p/¢ ur lowest terms.) “Tint: You will need! the 
notion of a dense set, introduced in Problem 8-6, as well as the results of 


Problem 30. 


Ifa <b<c<d and ff is integrable on [a,d], prove that f is integrable on 
{b,c}. (Don’t work hard.) 


(a) Prove that if f ts mtegrable on [a,b] and f(x) > O for all x m [a,b], 


b 
then f Pe UO 
a 
(b) Prove that if f and g are integrable on [a,b] and f(+«) > g(x) for all x 
b b 
in [a, b], then ie g. (By now it should be unnecessary to warn 


a a 
that if you work hard on part (b) you are wasting time.) 


Prove that 
b b+e 
i (@dax = i: f(x -—c)dx. 
a ate 
(The geometric interpretation should make this very plausible.) Hint: Every 
partition "P == {ipen ae} ot [tsb] "ores rise to a partion 7? — slip 4 ce 
..s<h +¢} of [a+ e¢,b +c], and conversely. 


#15. 


216. 


17. 


18. 


WE 


20. 
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bor a,b > | prove that 


a b ab 
l 1 l 
—dt+ —-dt= — dt. 
lof ee! if 

a ab 
Hint: This can be written | /rar = | 1/tdt. Every partition P = 

| b 
{fg tA)-ofe(il, aljegiveserise to a partition P= {bip,..-, be,) of [bab 
and conversely. 
Prove that 


cb b 
/ TG@dgsc k hice. 


(Notice that Problem 15 is a special case.) 


Given that the area enclosed by the unit circle, described by the equation 
x? 4 y* = 1, is a, use Problem 16 to show that the area enclosed by the 
ellipse described by the equation x7/a? + y?/b? = 1 is wab. 


b 
This problem outhnes yet another way to compute x" dx: it was used by 
é é 2 é 
a 


Cavalieri, one of the mathematicians working just before the invention of 
calculus. 


l a 
(a) etc. = | x" dx. Use Problem 16 to show that / x"dx =c,a"t!, 
0 0 


(b) Problem 14 shows that 


2a a 
7 yA Ee / (e+ a)eax 
0 —a 


Use this formula to prove that 


n 
Neg 9"! S (Ja. 


k even 


(c) Now use Problem 2-3 to prove that c, = 1/(m + 1). 


Suppose that f is bounded on [a,b] and that f is continuous at each point 
in [a,b] with the exception of x9 in (a,b). Prove that f 1s mtegrable on 
[a,b]. Hint: Imitate one of the examples in the text. 


Suppose that f is nondecreasing on [a,b]. Notice that f is automatically 
bounded on [a,b], because f(a) < f(x) < f(b) for x in [a, b]. 


a@jilf P= ge.,.-/n} isa partition of (a, b], whatisGy 2) anc’o'eP)? 

(Db) ouppesethait.—t,.1 — 0 for cachs. Provethaio (ee) — LC, Py = 
5[ f(b) — f(a)). 

(c) Prove that f is integrable. 

(d) Give an example of a nondecreasing function on [Q, 1] which is discon- 
tinuous at infinitely many pomts. 
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total area b- f—!(b) 


Fao) 


2 Ms 


area a - fo (a) 


PIGERE le 


22s 


It might be of interest to compare this problem with the following extract 
from Newton’s Prncipra.* 


LEMMA IT 


If in any figure Aack, terminated by the right hnes Aa, AE, and the curve ack, 
there be inscribed any number of parallelograms Ab, Be, Gd, &c., comprehended 
under equal bases AB, BC, CD, &c., and the sides, Bb, Gc, Dd, Ge., parallel 
to one side Aa of the figure; and the parallelograms al\bl, bLem, eMdn, @e., are 
completed: then if the breadth of those parallelograms be supposed to be diminished, 
and their number to be augmented 1 infinitum, J say, that the ultimate ratios 
which the mscribed figure AKDLeMdD, the circumscribed figure Aalbmendok, 
and curvihnear figure AabcdE, will have to one another, are ratios of equahty. 

For the difference of the inscribed and circumscribed figures is the 
sum of the parallelograms KI, Lm, Mn, Do, that is (from the equality 
of all their bases), the rectangle under one of their bases Kb and the 
sum of their altitudes Aa, that is, the rectangle ABla. But this rectangle, 
because its breadth AB is supposed diminished i wfiitun, becomes less 
than any given space. And therefore (by Lem. 1) the figures inscribed 
and circumscribed become ultimately equal one to the other; and much 
more will the intermediate curvilinear figure be ultimately equal to either. 


O.E.D. 


Suppose that f is increasing. Figure 16 suggests that 


fo l(b) 


bh 
ja =) fener (a= / ie 


a ipa l(a) 


(a) "lt P =aiges...t:¢ 1s a_partivon off 2 Jb ite ifs a) et 


f\(t,)}. Prove that, as suggested in Figure 17, 


Loe... P)+U. P)=bf (Getafe "| 


(b) Now prove the formula stated above. 


b 


(c) Find vi ax jor 0 =a =D. 


a 


Suppose that f is a continuous increasing function with f(0) = 0. Prove 
that for a,b > Owe have loung’s inequahty, 


a b 
ab< [ f(xydx + i} @).ase 
0 0 


and that equality holds if and only if b = f(a). Hint: Draw a picture like 
Figure 16! 


Newton's Principia, A Revision of Mott's ‘Translation, by Florian Cajori. University of ( lalifornia 
FIGURE 17 Press, Berkeley, California | 046, 
] ) ’ 


PGES: 
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(a) Prove that if f is integrable on [a,b] and m < f(x) < M for all x in 
[a,b], then 


b 
/ f(x)dx = (b-—a)p 


a 


for some number jt with m < p< M. 
(b) Prove that if f is continuous on [a, b], then 


b 


f(x)dx = (b—a)f(&) 


a 


for some & in [a, b]. 
(c) Show by an example that continuity is essential. 


(d) More generally, suppose that f is continuous on [a,b] and that g is 
integrable and nonnegative on [a,b]. Prove that 


b b 
/ fg) dx = fe) | eds 


a a 
for some € in [a,b]. This result is called the Mean Value Theorem for 
Integrals. 
(ec) Deduce the same result if g is mtegrable and nonpositive on [a, 5]. 


(f) Show that one of these two hypotheses for g is essential. 


In this problem we consider the graph of a function in polar coordinates 
(Chapter 4, Appendix 3). Figure 18 shows a sector of a circle, with central 


5 A z 5 eas 5 4 = 
angle 6. When @ is measured in radians, the area of this sector is r--=. Now 


Ww] D 


consider the region A shown in Figure 19, where the curve is the 
polar coordinates of the continuous function f. Show that 


raph in 


gg 


0 


1 fa 
area A = = f(0)7d0. 


Ay 


eG fj be.a*contimucustuncion on |ia, bjt Hf P = fips. t,} is a partition of 
[a, b|, define 


HW 


2G a 


i=] 


5 
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FIGURE 20 


PIGWRE 21 


26. 


The number €(f, P) represents the length of a polygonal curve inscribed in 
the graph of f (sec Figure 20). We define the length of f on [a,b] to be 
the least upper bound of all €(f, P) for all partituons P (provided that the sct 
of all such €(f, P) is bounded above). 


(a) If f is a lnear function on [a,b], prove that the length of f is the 
distance from (a, f(a)) to (b, f(b)). 

(b) If f is not hnear, prove that there is a partition P = {a,t, b} of [a,b] 
such that €(f, P) is greater than the distance from (a, f(a)) to (b, f(b)). 
(You will need Problem 4-9.) 

(c) Conclude that of all functions f on [a,b] with f(a) = c and f(b) =d 
the length of the near function is less than the length of any other. (Or, 
in conventional but hopelessly muddled terminology: “A straight linc is 
the shortest distance between two points”.) 

(d) Suppose that f’ is bounded on [a,b]. If P is any partition of [a,b] 

show that 


E( Vieni P) = Of. Py=U(V 14 ) ap). 
Hint: Use the Mean Value ‘Theorem. 
(ec) Why is sup{Z(V 1+ Coe P)\ <sup{é(f, P)}? (This is casy.) 
(f) Now show that sup{€( fi P)} < ee I+ Ge Py. thereby proving 


VALE Gf jean vy lena 2 isamte= 


grable on [a,b]. Hint: It suffices to show that if P’ and P” are any two 
partitions, then €(f, P’) < U(v 1+ Gn Pp”). If P contains the points 
of both P’ and P”, how does €(f, P’) compare to €(f, P)? 

(2) Let £(x) be the length of the graph of f on [a.x], and let d(x) be the 
Ieneth of the straight line segment from (a, f(a)) to (x, f(x)). Show 
“a if V1+(f')7 is integrable on [a,b] and f’ is continuous at a@ (ic., 

hm, (ey) Ce) tlien 


x—>at 


that the length of f on [a,b] 1s 


me (x) 
lim = 
xat d(x) 


Hint: It will help to use a couple of Mean Valuc ‘Theorems. 
(h) In Figure 21, the part of the graph of f betwcen ‘ and 5 is Just half the 


size of the part between t and 1, the part between ‘ and t is Just half’ 


tc. Show that the conclusion of 


tol — 


the size of the part between i and 
part (g) does not hold for this /. 


A function s defined on [a, b] ts called a step function if there is a partition 
P = {tg, ...,t,} of [a, b] such that s is a constant on each (4)~1. 4) (the values 
of s at 4 may be arbitrary). 


(a) Prove that if f is integrable on [a,b], then for any ¢ > O there is a step 


aap of 


28. 


29. 


*30. 


4315 
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b 
function s; < f with | vA | 51 < €, and also a step function 52 > f 
a 
b b 
with s2- SS 


a a 
(b) Suppose that for all e¢ > 0 there are step functions sj < f and sz > f 


b b 
such that / oo be / s; <&. Prove that f is integrable. 
‘ b 
(c) Finda function f which is not a step function, but which satisfies i — 


a 


L(f. P) for some partition P of [a,b]. 


Prove that if f is integrable on [a, b], then for any ¢ > O there are continuous 


L® 


b b 
functions g < f < h with | h -| g <e. Hint: First get step functions 
with this property, and then continuous ones. A picture will help immensely. 
(a) Show that if sy; and s2 are step functions on [a,b], then s; + s2 1s also. 


b bh bh 
(b) Prove, without using Theorem 5, that (sj + 52) =| S| +f» 


(c) Use part (b) (and Problem 26) to give an alternative proof of Theorem 5. 


Suppose that f 1s pute sual on [a,b]. Prove that there 1s a number x in 
b 
[a,b] such that — = f. Show by example that it is not always possible 


to choose x to ‘we in (a, By, 


The purpose of this problem is to show that if f is integrable on [a, b], then 
f must be continuous at many points in [a, 5]. 


(a) LetiP Sigpeeig:) be a, partition of [agb| with UG6P) — LG, P) = 
b —a. Prove that for some i we have M; — mn; < 1. 

(b) Prove that there are numbers a; and bj with a < a; < hb) < b and 
sup| A=) = ayeeresel nimi f (x) 2 ay Se = 51) <1 Shou can*aheose 
a1, 61] = [t-1, t| from part (a) unless i = | or n; and in these two cases 
a very simple device solves the problem.) 

(c) Prove that there are numbers az and b2 with a; < a2 < bo < by; and 
sup{ f(x) :a2 <x < bo} —inf{ f(x): a2 < x < bo) < 5. 

(d) Continue in this way to find a sequence of intervals J, = [dn, bn] such 
that suphiG@ eis, ) — int ( f(r): xin 7,}) < Pa Apply the "Nested 
Intervals Theorem (Problem 8-14) to find a point x at which f is con- 


tinuous. 
(ce) Prove that f is continuous at infinitely many points in [a, b]. 
b 
Let f be mtegrable on [a,b]. Recall, from Problem 13, that ant 


a 


f(&) = 0 for all x in [a, 5}. 
(a) Give an example where f(x) > 0 for all x, and f(v) > 0 for some x in 
b 
[a,b], and ie— 05 


a 
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2 O72; 


IOs 


Poa. 


weer 


*36. 


of. 


(b) Suppose f(x) > O for all x in [a,b] and f is continuous at xo in [a, b] 


b 

and f(x9) > 0. Prove that i! f > 0. Hint: It suffices to find one lower 
a 

sum L(f, P) which is positive. 


(c) Suppose f is integrable on [a,b] and f(x) > 0 for all x in [a, b]. Prove 
b 
that f > 0. Hint: You will need Problem 30; indeed that was one 


a 
reason for including Problem 30. 
b 
(a) Suppose that f is continuous on [a, b] and fg =0 for all continuous 
a 
functions g on [a,b]. Prove that f = 0. (This is easy; there is an obvious 
g to choose.) 


b 
(b) Suppose f is continuous on [a,b] and that fg = 0 for those con- 


tinuous functions g on [a,b] which satisfy the extra conditions a 
g(b) = 0. Prove that f = 0. (This innocent looking fact is an important 
lemma in the calculus of variations; see reference [22] of the Suggested 
Reading.) Hint: Derive a contradiction from the assumption f (x9) > 0 
or f (x9) < 0; the g you pick will depend on the behavior of f near xo. 


ket (Cr) '= » torxeratonaliand ((x) =!0'for ¥ irrational: 

(a) Compute L(f, P) for all partitions P of [0,1]. 

(b) Find inf{U(f, P): P a partition of [0, 1)}. 

Let f(x) = 0 for irrational x, and 1/q if x = p/q in lowest terms. Show 
that f is integrable on [0, 1] and that / f = 0. (Every lower sum is clearly 
0; you must figure out how to make roe sums small.) 


Find two functions f and g which are integrable, but whose composition 
5 § ao b) 
go f isnot. Hint: Problem 34 is relevant. 


Let f be a bounded function on [a,b] and let P be a partition of [a, 6]. 

Let M; and m; have their usual meanings, and let M;’ and m;’ have the 

corresponding meanings for the function | f}. 

(a) Prove that M;’ — mm,’ < M; —1m;j. 

(b) Prove that if f is integrable on [a, b], then so is | f}. 

(c) Prove that if f and g are integrable on [a,b], then so are max(f. g) and 
min( f. g). 

(d) Prove that f is integrable on [a,b] if and only if its “positive part” 
max(f,0) and its “negative part” min(f, 0) are integrable on [a, b]. 


Prove that if f is integrable on [a, b], then 


b 
< / ral. 


Hint: ‘This follows easily from a certain string of inequalities; Problem 1-14 


b 
f(tdt 


a 


is relevant. 


sro 


39: 
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Suppose f and g are integrable on [a,b] and f(x), g(x) = O for all x in 
[a,b]. Let P be a partition of [a,b]. Let Mj’ and m;’ denote the appropriate 
sup’s and inf’s for f, define M;” and m;” similarly for g, and define M; and m; 
similarly for fg. 
(a) Prove that M; < M,'M;" and m; > m,’m;". 
(b) Show that 
CH OM. P) = Li fg. P) =< > [Mi'M;" = mm," \(t; — ry. 
i=) 
(c) Using the fact that f and g are bounded, so that | f(x)|, |g(«)| < M for 
x in [a, b], show that 


Uife, P)yS LC a 


H n 

<M [um — mj] (t; — 1) + y[Mi" — mj") (t; - 1-0] : 
i=] i= 

(d) Prove that fg is integrable. 

(e) Now eliminate the restriction that f(x), g(x) > 0 for x in [a,b]. 


Suppose that f and g are integrable on [a,b]. The Cauchy-Schwarz inequality 


states that . 5 . 
(UL) =< )(L*) 


(a) Show that the Schwarz inequality is a special case of the Cauchy-Schwarz 
inequality. 

(b) Give three proofs of the Gauchy-Schwarz inequality by imitating the 
proofs of the Schwarz inequality in Problem 2-21. (The last one will 
take some imagination.) 

(c) If equality holds, is it necessarily true that f = Ag for some A? What if 
f and g are continuous? 


‘alle 
(d) Prove that (| ‘) = (/ a Ts thas’ xesultitruc if Osand | axe 
0 0 


replaced by a and b? 


Suppose that f is integrable on [0, x] for all x > O and lm f(x) =a. Prove 
XO 


that 
1 ix 

lim -| f(jda=a. 

J 10.8) OE 0 
Hint!’ The condition lm f(x) = a@ implies that f(t) 1s close to a for 

2 ime 2 2) 

N+M 

t > some N. This means that f(t) dt is close to Ma. If M is large in 


N 
comparison to N, then Ma/(N + M) is close to a. 


282 Derwwatives and Integrals 


Aa=1o Xt x2 f= 
FIGURE 1 
THEOREM 1 
PROOF 


APPENDIX. RIEMANN SUMS 


Suppose that P = {to,....f,} 18 a partition of [a,b], and that for each i we 
choose some point x; in [f;-1, 4]. Then we clearly have 


H 
i FEDS SONG =F UEP), 
Nn i=l 
Any sum a f(x) — 1) 1s called a Riemann sum of f for P. Figure | shows 
i=! 
the geometric interpretation of a Riemann sum; it is the total area of n rectangles 
that he partly below the graph of f and partly above it. Because of the arbitrary 
way in which the heights of the rectangles have been picked, we can’t say for 


sure whether a particular Riemann sum is less than or greater than the mtegral 
b 


f(x)dx. But it does seem that the overlaps shouldn’t matter too much; if the 


a 
bases of all the rectangles are narrow enough, then the Riemann sum ought to be 
close to the mtegral. ‘The followmg theorem states this precisely. 


Suppose that f is integrable on [a,b]. Then for every ¢ > 0 there is some 6 > 0 
such that, if P = {f,...,¢,} is any partition of [a, b] with all lengths t; —t;_| < 6, 
then 


u b 
yy MG) Giatimid) f Cex | =e; 


iI 


for any Riemann sum formed by choosing x; in [f;—1. t]. 


Since the Riemann sum and the integral both he between L(f, P) and UCf. P), 
this amounts to showing that for any given € we can make U(f, P) — L(f, P) < 
by choosing a 6 such that U(f, P) — L(f, P) < © for any partition with all lengths 
Fe oy 

The definition of f being integrable on [a, b] includes the condition that | f] < 
M for some M. First choose some particular partition P* = {ug,..... uk} for 
which 


UEC f@P* )s— da@fak” Va e/2, 


and then choose a 6 such that 


ee 
*4MK 


For any partition P with all ¢ — 4-1 < 46, we can break the sum 


WH 
U(f. P)— L(f. P) = DM: ~ mii = 4-1) 

iJ 
into two sums. ‘The first involves those i for which the interval [f;—1, ¢] 1s com- 
pletely contained within one of the intervals [wj;—1.u;]. ‘This sum is clearly < 
UGS, P*) — E(fPP)\ = 272 For all other # we wilthave 7.5) = 16; = & for 
Some) — les K — 1, so there are at most K — | of them. Consequently, the 
sum for these terms is < (K — 1)-2M-6 < ¢/2.J 


(u(t) ), v(t1)) 


HG RIE 2 


(u(to), v(to)) 
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The moral of this tale is that anything which looks like a good approximation 


to an mtegral really is, provided that all the lengths ¢; — t;-; of the intervals in the 


partition are small enough. Some of the following problems should bring home 


this message with even greater force. 


PROBLEMS 


1. 


Suppose that f and g are continuous functions on [a,b]. For a partition 
P= {fo,,-2-3 8,001 [ab] choosea set af poms 4, 1n)||7;-7, 7) || and anothemser 
of points uw; m [f;-1, ti]. Consider the sum 


S- fra (nite = t-1). 
i 


Notice that this 1s not a Riemann sum of fg for P. Nevertheless, show that 
b 


all such sums will be within ¢ of | fg provided that the parttion P has all 


a 
lengths 4; — 4,-; small enough. Hint: Estimate the difference between such a 
sum and a Riemann sum; you will need to use uniform continuity (Chapter 


8, Appendix). 


This problem is stmilar to, but somewhat harder than, the previous one. 
Suppose that f and g are continuous nonnegative functions on [a,b]. Fora 
partition P, consider sums 


So Vf Gi) + gui) (i — G1). 


=| 


b 
Show that these sums will be within ¢ of Jf +g wall t; —4_) are small 


a 
enough. Hint: Use the fact that the square-root function is uniformly con- 
tinuous on a closed interval [0, M]. 


Finally, we're ready to tackle something big! (Compare Problem 13-25.) 
Consider a curve ¢ given parametrically by two functions u and v on |[a, b]. 
For a partition P = {to,...,t,} of [a, b] we define 


iH 


ive. 7 E SE 


i=l 


[u(t;) — u(y) ]? + [vG@) — vy.) ]?: 


this represents the length of an mscribed polygonal curve (Figure 2). We 
define the length of ¢ to be the least upper bound of all €(f, P), if it exists. 
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Prove that if uw’ and v’ are continuous on [a, b], then the length of c is 


b 
/ Vvu'2 + y/2 
a 


Let f’ be continuous on the interval [69, 4;]. Show that the graph of f in 
polar coordinates on this interval has the length 


Ay 
| Vf? ie 


Using Theorem 1, show that the Cauchy-Schwarz inequality (Problem 13-39) 
is a consequence of the Schwarz inequality. 


CHAPTER 


THEOREM 1 (THE FIRST 
FUNDAMENTAL THEOREM 
OF CALCULUS) 


PROOF 


THE FUNDAMENTAL THEOREM 
OL CALCULUS 


From the hints given in the previous chapter you may have already guessed the 
first theorem of this chapter. We know that if f is integrable, then F(x) = f” f is 
continuous; it is only fitting that we ask what happens when the original function f 
is continuous. It turns out that F is differentiable (and its derivative is especially 
simple). 


Let f be integrable on [a,b], and define F on [a, b] by 


Fa) = [ f. 


If f is continuous at c in [a,b], then F is differentiable at c, and 
EAC ii ier 


df c =a or b, then F'(c) is understood to mean the right- or left-hand derivative 
ol F.) 


We will assume that c is in (a,b); the easy modifications for c = a or b may be 
supphed by the reader. By definition, 
. F(e+h)— Fic) 
E'(o.- ———S—_ 
h-0O h 
Suppose first that h > 0. Then 
cth 


Fic +h) —- F(c) = fe 


Define m);, and M;, as follows (Figure 1): 


nepal) Caex ce oh), 
Mie sb (ee ero Se ly. 


It follows from ‘Theorem 13-7 that 


cth 
ny; se / Ff <iM), -h. 
: 


‘Therefore 


F(cth)—F(c 
mp < Fe Eby < My. 
h 
If h < 0, only a few details of the argument have to be changed. Let 
my = mit p(X) 2c +k = x = 4); 
My, = sup WG) 2c 1s & = cl. 


285 
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Cc ct+h 


FIGURE 1 
Then . 
my, - (—h) =) fs Ch): 
ct+h 
Since 
cth c 
F(c +h) — F(c) = f=- i 
C ct+h 


this yields 
mn-h> F(c+h)— F(c) > M,-h. 


Since h < 0, dividing by fh reverses the inequality again, yielding the same result 


as before: 


Fic +h) — F(e 
Mp < cis onal) oni) : ) < M;.. 
1 


This inequality is true for any integrable function, continuous or not. Since f 1s 


continuous at c, however, 


hina 770, — lim Mj, = fie), 


h>0 > 
and this proves that 
F(c +h) — F(c) 


nn 


Although Theorem | deals only with the function obtained by varying the upper 
limit of integration, a simple trick shows what happens when the lower limit is 


b 
G(x) = / Is 


varied. If G is defined by 


COROLLARY 


PROOF 
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then 
b x 
a= fo r- fs 
a a 
Consequently, if f is continuous at c, then 
Gc) =—f(c). 


The minus sign appearing here is very fortunate, and allows us to extend Theo- 
rem | to the situation where the function 


F(x) = a i 


is defined even for x <a. In this case we can write 
a 
F(x)=- / lee 
8 


Fi(ec) =—C fle) = fo), 


so if c < a we have 


exactly as before. 

Notice that in either case, differentiability of F at cis ensured by continuity of f 
at c alone. Nevertheless, Theorem | is most interesting when f is continuous at 
all points in [a,b]. In this case F is differentiable at all points in [a,b] and 


F=f 


In general, it is extremely difficult to decide whether a given function f is the 
derivative of some other function; for this reason Theorem 11-7 and 
Problems 11-60 and 11-61 are particularly interesting, since they reveal certain 
properties which f must have. If f is continuous, however, there is no problem 
at all—according to Theorem |, f zs the derivative of some function, namely the 


Pay = / yr. 


Theorem | has a simple corollary which frequently reduces computations of 


function 


integrals to a triviality. 
If f is continuous on [a,b] and f = g’ for some function g, then 


b 
/ f = g(b) — g(a). 


F(x) = [ ie 


Then F’ = f = g’ on [a, b]. Consequently, there is a number c¢ such that 


Let 


Feet +c. 


288 Derwwatives and Integrals 


The number ¢ can be evaluated easily: note that 
O= F(a) = ea): 


so c = —g(a); thus 


F(x) = g(x) — g(a). 
This is true, in particular, for x = b. ‘Thus 


b 


f = F@®) = gtb) — g(a). ] 


ad 


The proofof this corollary tends, at first sight, to make the corollary seem useless: 
after all, what good is it to know that 


b 
i f =2(b) — g(a) 


a 
° ° 7 oP & + . ~ . . 
if g is, for example, g(x) = f, f 2? The point, of course, is that one might happen 
to know a quite different function g with this property. For example, if 
3 
/ 7 
63 z and") five)"= ie. 


then g’(x) = f(x) so we obtain, without ever computing lower and upper sums: 


[ 2, ae a 
; Xx od 3 a 


One can treat other powers similarly; if # is a natural number and g(x) = 
x't1/(n + 1), then g’(x) =x", so 


b . prt! qt! 
ee § 
a 


n+ 1 Ree | 


For any natural number n, the function f(x) = x~" is not bounded on any interval 
containing OQ, but if a and b are both positive or both negative, then 


b —nt+l —n+] 
emt ad  —— aS — oe 
m —n+1] -—-n+1 


Naturally this formula is only true for n 4 —1. Jle do not know a simple expression for 


| b | 
—dx. 
a * 


The problem of computing this integral is discussed later, but it provides a good 
opportunity to warn against a serious error. ‘The conclusion of Corollary | 1s often 
confused with the definition of integrals——many students think that ks f is defined 
as: “g(b) — g(a), where g is a function whose derivative is ff.” ‘This “definition” is 
not only wrong it is useless. One reason is that a function f may be integrable 
without being the derivative of another finetion. For example, if f(x) = 0 for 
x #land f(t) = 1, then f is integrable, but f cannot be a derivative (why not?). 
There is also another reason that is much more important: If f is continuous, 
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then we know that f = g’ for some function g; but we know this only because of 
Theorem 1. Vhe function f(x) = 1/x provides an excellent illustration: if x > 0, 


then f(x) =-9'(~)sawhere 
x l 
g(x) =| — dt, 
ie 


and we know of no simpler function g with this property. 

The corollary to Theorem | is so useful that it is frequently called the Second 
Fundamental ‘Theorem of Calculus. In this book, that name is reserved for a 
somewhat stronger result (which in practice, however, is not much more useful). 
As we have just mentioned, a function f might be of the form g’ even if f is not 
continuous. If f is integrable, then it is still true that 


b 
f = 2(b) — g(a). 


a 


The proof, however, must be entirely different——we cannot use Theorem 1, so we 
must return to the definition of integrals. 


THEOREM 2 (THESECONDFUNDA- If f is integrable on [a,b] and f = g’ for some function g, then 


MENTAL THEOREM OF CALCULUS) b 
f = 9(b) — gla). 


a 


PROOF — Let P = {fo,..., t,} be any partition of [a,b]. By the Mean Value Theorem there 
is a point x; im [f;-1, 4] such that 


g(t) — g(ti-1) = 2 Gi — t-1) 
a ee 


Pig (et oe Ts 
Mr supty A) 2 ho| =x = hf, 


then clearly 
me (t; —W 1 ee a) = G9) 


that is, 
Mi (le Seis) et) 
Adding these equations for 7 = 1,...,2 we obtain 


iW n 


EG — tj-1) < g(b) — g(a) < So Milt; aati) 
so that 
BU DRED (ae iar) 
for every partition P. But this means that 


b 
gsdb)-s@m=] fl 


a 
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We have already used the corollary to Theorem | (or, equivalently, ‘Theorem 2) 
to find the integrals of a few elementary functions: 


‘ et ae pee a A (a and b both positive or 
x" dee - ng ce 
5 n+1 n+l both negative if n > 0). 


As we pointed out in Chapter 13, this integral does not always represent the area 
bounded by the graph of the function, the horizontal axis, and the vertical Imes 
through (a,0) and (6,0). For example, if a < 0 < b, then 


b 
[8a 
a 


does not represent the area of the region shown in Figure 2, which is given 
imstead by 


= [ova +f Sav=- eae Pe 
i im 7 4 4 4 4 

a i 

mae aa 


FIGURE 2 Similar care must be exercised in finding the areas of regions which are bounded 
by the graphs of more than one function—a problem which may frequently involve 
considerable ingenuity in any case. Suppose, to take a simple example first, that 
we wish to find the area of the region, shown in Figure 3, between the graphs of 
the functions 

2 3 


f(x)=x 


and! gia) =x 


on the interval [0, 1]. If 0 < x < 1, then 0 < x? < x’, so that the graph of g lies 


below that of f. The area of the region of interest to us 1s therefore 


area R(f, 0, 1)— area R(g.0, 1), 


| i 
Pig c— t= 
fs dx fos dx = 3-473: 
0 0 


‘his area could have been expressed as 


b 
/ OP 


If g(x) < f(x) for all x in [a, b], then this integral always gives the area bounded 


which is 


by f and g, even if f and g are sometimes negative. ‘The easiest way to see this is shown 
in Figure 4. If ¢ 1s a number such that f +c aud g +c are nonnegative on [a,b], 


reURR3 then the region Ry, bounded by f and g, has the same area as the region Ro, 


FIGURE 4 


i sing 


eave 


& |--- 
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bounded by f +c and g +c. Consequently, 


b b 
aréa Ry = areawk safe (f +c) —efen(ockc) 
ao a 
=f Wrto-@+ol 
on 
iy El a 


a 
his observation is useful in the following problem: Find the area of the region 
bounded by the graphs of 


3 3 9 
{OOS ER cand? eax. 
The first necessity is to determine this region more precisely. The graphs of f 
and g intersect when 
i 
Er aie 
3 2 
Ofer t aaa — x — 0: 


or x(x? —x—-1)=0, 


Wo 5 eS, 


2 2 


— 


or 26 


@nmhe interval ({ik = JS ]/2,.0) we: have x3 — x > x? and on the interval 
(0. [1 + V5]/2) we have x2 > x3 — x. These assertions are apparent from the 
graphs (Figure 5), but they can also be checked easily, as follows. Since f(x) = g(x) 
anlar x — Oo l= V5 |/2, or [1 - V5)/2, the function / — g does not change sign 
on the intervals ({ 1 — V5 |/2.0) and (0, [1+ V5 ]/2); it is therefore only necessary 


to observe, for example, that 


to conclude that 
f—2= 0s m (i —w/5]/2,0), 
f= 0) toni(0, [1-2/5 1/2). 
The area of the region in question is thus 


0 Eas 
| K Ce Oye +/ = Ce — x)| dx. 


= 0 


As this example reveals, one of the major problems involved in finding the areas 
of a region may be the exact determination of the region. There are, however, 
more substantial problems of a logical nature —we have thus far defined the areas 
of some very special regions only, which do not even include some of the regions 
whose areas have just been computed! We have simply assumed that area made 
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FIGURE 5 


sense for these regions, and that certain reasonable properties of “area” do hold. 
These remarks are not meant to suggest that you should regard exercising ingenuity 
to compute areas as beneath you, but are meant to indicate that a better approach 
to the definition of area is available, although its proper place is somewhere in 
advanced calculus. The desire to define area was the motivation, both in this 
book and historically, for the definition of the integral, but the integral does not 
really provide the best method of defining areas, although it is frequently the proper 
tool for computing them. 

It may be discouraging to learn that integrals are not suitable for the very pur- 
pose for which they were invented, but we will soon see how essential they are for 
other purposes. The most important use of integrals has already been emphasized: 
if f is continuous, the integral provides a function y such that 


yx) = f(x). 


This equation is the simplest example of a “differential equation” (an equation 
for a function y which involves derivatives of y). The Fundamental Theorem 
of Calculus says that this differential equation has a solution, if f is continuous. 
In succeeding chapters, and mn various problems, we will solve more complicated 
equations, but the solution almost always depends somehow on the integral; in 
order to solve a differential equation it is necessary to construct a new function, 
and the integral is one of the best ways of doing this. 

Since the differentiable functions provided by the Fundamental ‘Theorem of 
Calculus will play such a prominent role in later work, it is very important to 
realize that these functions may be combined, like less esoteric functions, to yield 
still more functions, whose derivatives can be found by the Chain Rule. 

Suppose, for example, that 


33 


NX | 
71) = [ > ==). al ie 
Ja I+sin°t 
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Although the notation tends to disguise the fact somewhat, f is the composition 
of the functions 


ae 1 
Clon = x> and (Ce) — i an 
a l+sin‘t 
In fact, f(x) = F(C(x)); m other words, f = F oC. Therefore, by the Chain 
Rule, 


f-@) = F (C@)ee eG 


= F’ (x?) - 3x7 
l 
==> SELLS 3x2. 
1 + sin* x3 


If f is defined, instead, as 
a 1 
rots ak 
3 1+sin‘t 


] ) 
f' (x) = — ——— 3x’. 
1+ sin? x3 


then 


If f is defined as the reverse composition, 
x l 3 
f(x) = (| ——;- a) 
a 1+sin*1 


f @) = G@) 2G) 


My s 
a 1+sin‘t 1 + sin“ x 


sin x 1 
f(x) =|! ——— dt, 


1+ sin? t 
a l 
g(x) = et, 
sinx 1 + sin“ t 


x 1 
his) = sin ( | —— at), 
a 1+sin“t 


1 
1+ sin? (sin x) 
—| 


ey, A 
1 + sin*(sin x) 


F % ] l 
h ()i=TC0S aS lh) , cope 
a 1+sin‘t 1 + sin* x 


then 


Similarly, if 


then 


fe)= 


SCOSX, 


g i= 


-COSX, 
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The formidable appearing function 


Ol jv ty at} lel 


ee) 
a 1+ sin‘ t 


is also a composition; m fact, f = F o F. Therefore 


f Cae (F (x)) eGo) 
I 1 


1 + sin* (| or ar) ] + sin* x 
a |+sin*t 


As these examples reveal, the expression occurring above (or below) the integral 
sign indicates the function which will appear on the mght when f is written as a 
composition. As a final example, consider the triple compositions 


x 1 
Ga) UO rear) 
a sin? ¢ ge rn aes It 
Tee = Ht : ls “dp, g(x) = Hl ih l+sin“ 1 : eels dt. 


ia Te 
a ae Sth a lees ee 


which can be written 
pore oC and yee = er ommcrh: 


Omitting the mtermediate steps (which you may supply, if you still feel msecure), 


we obtain 


] l 
f'Q) = ——— oe  ”., 
— a I Pisina 
li sits SS 
a I1+sin‘t 
| ] 
eo ——— ee . ae .  n7a e e 
5 (/. AREF ar) l ] + sin? (| Sas ar) 
]+sin eer nen a 1+sm*t 
a 1+ sin*t 
| 
I+ sin? x 


Like the simpler differentiations of Chapter 10, these manipulations should be- 
come much easier after the practice provided by some of the problems, and, like 
the problems of Chapter 10, these differentiations are simply a test of your under- 
standing of the Cham Rule, in the somewhat unfamiliar context provided by the 
Fundamental Theorem of Calculus. 

The powerful uses to which the integral will be put in the following chapters 
all depend on the Fundamental ‘Vheorem of Calculus, yet the proof of that the- 
orem was quite easy— it seems that all the real work went mto the definition of 
the integral. Actually, this is not quite true. In order to apply Vheorem | to a 
continuous function we need to know that if f is continuous on [a,b], then f is 
integrable on [a,b]. Although we've already offered one proof of this result, there 
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is a more elementary argument that you might prefer. Like most “elementary” 
arguments, it’s quite tricky, but it has the virtue that it will force a review of the 
proof of Theorem 1. 


If f is any bounded function on [a, b], then 


sup{L(f, P)} and 


inf{U(f, P)} 


will both exist, even if f is not integrable. ‘These numbers are called the lower 
integral of f on [a,b] and the upper integral of f on [a,b], respectively, and 
will be denoted by 
b b 
L y ameecveve| mi! if 


a a 


The lower and upper integrals both have several properties which the integral 
possesses. In particular, if a <c < b, then 


b 
i f =L 


c b b c b 
fo f+ f and uf r-uf seu f: 


and if m < f(x) < M for all x in [a,b], then 


b b 
mib- ays f oe) f <M(b—-a). 


a 
The proofs of these facts are left as an exercise, since they are quite similar to the 
corresponding proofs for integrals. ‘The results for mtegrals are actually a corollary 


of the results for upper and lower integrals, because f is integrable precisely when 


b b 
Lf fi=Ul fF 


a 


We will prove that a continuous function f is integrable by showing that this 
equality always holds for continuous functions. It is actually easier to show that 


ents 


for all x in [a,b]; the trick is to note that most of the proof of Theorem 1| didn’t 
even depend on the fact that f was integrable! 


THEOREM 13-3 


If f is continuous on [a. b], then f is integrable on [a, b]. 


PROOF — Define functions L and U on [a,b] by 


Lay=Lf (peal yoy =u f ue 


[et x be it Gb). hh = and 


mus inf (fe) 2x 
M, 


<t<x«t+h}, 
=sup( f(Phexw =< ft < x 4h}, 
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then 
x+h x+h 
mph = f fsuf f <M,-h, 
SO | 
my, hb = eh) — L(x) Oe 4h) — OG) = Mi, hk 
or 


Loi Lea)s* Ux eh) — UG) 
< —_— « —____ « 


1 Mh. 
fas h h t 


If h <Oand 


Ma intl iC) 2x ht S26). 
Mp supl f(t) ew Stak) 


one obtains the same inequality, precisely as in the proof of Theorem 1. 
Since f is continuous at x, we have 


mn < ae Min INE): 
and this proves that 
LAU @) = fix) tore meG7)). 
This means that there is a number c such that 
UiG@oi=L@)-He forall xim.|a,)). 


Since 
U(a) = L(a) = 0, 


the number c must equal 0, so 
UG)—L() tor allia%m a,b): 


In particular, 
b b 


U/] f=Ub=Lb)=L] fF, 


a a 


and this means that f is integrable on [a,b]. J 


PROBLEMS 


1. Find the derivatives of each of the following functions. 


a} 


(1) (269) = ‘i sin? t dt. 


a 


(/, sin’ rdr) | 
(i) . F(x) = it ae ee 
3 


1+ sin’ t + t2 


x y | 
5 \J8 1+t*+sin*t 


b | 
x 1+t*+sin‘*t 
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b x 
(v) F(x) = 4) a at 
a 1+t++sin‘*t 


(vi) F(%) =sin ([ sin (/ sin’ dr) ay). 
0 0 


x i] 
(vil) Ray where F(x) = / — dt. 
ie 22 (Find (F-!)’(x) in terms of 
EG) 


xX 


| 
(vill) F-!, where F(x) = if 
For each of the following f, if F(x) = hs f, at which points x 1s F’(~) = 
f(x)? (Caution: it might happen that F’(x) = f(x), even if f is not contin- 
uous at xX.) 


at. 


(i) Ge) — Ontiee tly Ce) bat x 1. 

VY efter Oita real, ic) v1 af > I. 

na CaO mipe—len yi Gy) — il at x L. 

iv) f@)—]Onx isirrational, f(x) = 1/¢ it x = p/¢:-m lowest terms. 
Vv)” “HiGs) SOO ex af x = 0! 

vi) $G) —Onire=Wormx ol, f(x) = 1/(l/ajat 0=—.=r 

(vii) f is the function shown in Figure 6. 


(vit) f(s) = tat ily itor some nin N, f@) = 0 otherwise: 


jee = ee 2 oo 


FIGURE 6 


Show that the values of the following expressions do not depend on x: 


% 1 1/x 1 
—~ dt + —— dt. 
0) / 1+? ; | (ea ; 


sin x 1 
(11) i ica die Sx (Oha/ 2): 
— COSXx i t2 
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=10: 


it EF 


Find (f—!)’(O) if 
QQ fA) = i 1 + sin(sin f) dt. 
0 


(ri ey Ze? i cos(cos f) dt. 
l 
(Don’t try to evaluate f explicitly.) 


Find a function g such that 


i) ih tg(t)dt =x +x. 
0 


il) i te(t)idtii=x* Pe 
0 


Notice that g is not assumed continuous at 0.) 


a) Find all continuous functions f satisfying 
/ f=(@)+C for some constant C 4 0 
0 


assuming that f has at most one 0. 

(b) Also find a solution that is 0 on an interval (—oo, b| with 0 < b, but 
non-zero for x > Db. 

(c) Finally, for C = 0 and any interval [a, b] with a < 0 < 5, find a solution 
that is 0 on [a, b], but non-zero elsewhere. 


Use Problem 13-23 to prove that 


( l ie I x° ae | 
i == < es 1/37 < S, 
/ 2 10) 1+ x2 7 


: 
3 U2 HN V3 

a) | ae ip oul 

a) et (ie eo 


Find F’@) af F@), = I xf(t)dt. (The answer is not xf (x); you should 
perform an obvious manipulation on the integral before trying to find F’.) 


Prove that if f is continuous, then 


ip f@(« —u)du= i) (| fat) du. 
0 0 0 


Hint: Differentiate both sides, making use of Problem 8. 


Use Problem 9 to prove that 


x me uz uy 
/ f(uy(x - u)* du = || ¢ i firydr) au) dup. 
0 0 0 0 


Find a function f such that f(x) = 1 / V1 + sin’ x. (This problem is 


supposed to be easy; don’t misinterpret the word “find.”) 


FIGURE 7 


12. 


13. 


*14. 


*1 9; 


16. 


a) 7. 


18. 


19. 


14. The Fundamental Theorem of Calculus 299 


A function f is periodic, with period a, if f(x +a) = f(x) for all x. 


(a) If f is periodic with period a and integrable on [0, a], show that 


b+a 
ie =| f for all b. 


(b) Find a function f such that f is not periodic, but f’ is. Hint: Choose 
a periodic g for which it can be guaranteed that f(x) = He g is not 
periodic. 

(c) If f’ is periodic with period a and f(a) = f(O), then f 1s also periodic 
with period a. 


*(d) Conversely, if f’ is periodic with period a and f is periodic (with some 


period not necessarily = a), then f(a) = f(O). 


Find le Vx dx, by simply guessing a function f with f’(v) = x, and using 
the Second Fundamental Theorem of Calculus. Then check with Prob- 
lem 13-21. 


Use the Fundamental Theorem of Calculus and Problem 13-21 to derive the 
result stated in Problem 12-21. 

Let C), C and C2 be curves passing through the origin, as shown in Figure 7, 
Each point on C can be joined to a point of C; with a vertical line segment 
and to a point of Cz with a horizontal line segment. We will say that C bisects 
C; and C2 if the regions A and B have equal areas for every point on C. 


(a) If C; isthe graph of f(x) = x?,x > Oand C is the graph of f(x) = 2x*, 
x > O, find C2 so that C bisects C) and Cp. 

(b) More generally, find C2 if C; is the graph of f(x) = x”, and C is the 
Crap Obes (i= eu. loncome a-ak. 

(a) Find the derivatives of F(x) = fy 1/t dt and G(x) = aie lt dt. 

(b) Now give a new proof for Problem 13-15. 


Use the Fundamental Theorem of Calculus and Darboux’s Theorem (Prob- 
lem 11-60) to give another proof of the Intermediate Value Theorem. 


Prove that if 4 is continuous, f and g are differentiable, and 


g(x) 
F(x) “ail h(t) dt, 
if 


F(X) 
then Oo) 90a ()) 92 Cosh Cf (anf (x)eeddint. Try (to xeduee this: to 
the two cases you can already handle, with a constant either as the lower or 
the upper limit of integration. 


Let f be integrable on [a, b], let c be in (a, b), and let 


Fa= fs wes 6 =H. 


For each of the following statements, give either a proof or a counterexample. 
(a) If f is differentiable at c, then F is differentiable at c. 

(b) If f is differentiable at c, then F’ is continuous at c. 

(c) If f’ is continuous at c, then F’ is continuous at c. 
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B20) 


21. 


a 


oe 


Let 
| 

cos—, «#0 
x 

oO Din 


fa)= 


Is the function F(x) = fy f differentiable at 0? Hint: Stare at page 179, 


Suppose that f’ is integrable on [0,1] and f(0) = 0. Prove that for all x in 
[O, 1] we have 


Show also that the hypothesis f(0) = 0 is needed. Hint: Problem 13-39. 


Suppose that f is a differentiable function with f(0) = 0 and 0 < f’ < 1. 
Prove that for all x > 0 we have 


(a) Suppose G’ = g and F’ = f. Prove that if the function y satisfies the 
differential equation 


(*) g(y(x))+ w(x) = f(x) for all x in some interval, 
then there ts a number c such that 
(>) G(y(x)) = F(x) +c for all x in this interval. 


(b) Show, conversely, that if y satisfies («*), then y is a solution of (x). 


(c) Find what condition y must satisfy if 
; 1 + x? 
ee 
1+ y(x) 
(In this case g(t) = 1+1t and f(t) = 1+ 7.) Then “solve” the resulting 
equations to find all possible solutions y (no solution will have R as its 
domain). 
(d) Find what condition y must satisfy if 
(x) = 
y (x) = ————: 
i 1+5[y()]4 
(An appeal to Problem 12-14 will show that there ae functions satisfying 
the resulting equation.) 
(e) Find all functions y satisfying 


y(x)y'(x) = —x. 


lind the solution y satisfying y(O) = —1. 


24. 


34 


26. 


oe 
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In Problem 10-19 we found that the Schwarzian derivative 


f(x) 7 4 (Gey 

oe a Ge 

was 0 for f(x) = (ax + b)/(cx +d). Now suppose that f is any function 
whose Schwarzian derivative 1s 0. 


(a) f’*/f'> is a constant function. 


(b) f is the form f(x) = (ax + b)/(cx +d). Hint: Consider u = f’ and 
apply the previous problem. 


on, OF 4 2N Crete et Oh F 2 ; OO CO ee 7 
The limit Jim [, f, if it exists, is denoted by f/f (or f, f(x) dx), and 


called an “improper integral.” 


(a) Determine ike X act yr eee | 

(b) Use Problem 13-15 to show that f;* 1/x dx does not exist. Hint’ What 
can you say about ie 1/x dx? 

(c) Suppose that f(x) > O for x > O and that tn f exists. Prove that if 
O < g(x) < f(x) for all x > O, and g is integrable on cach interval 
[0, N], then {5° g also exists. 

(d) Explain why {5° 1/(1 + x?) dx exists. Hint: Split this integral up at 1. 


Decide whether or not the following improper integrals exist. 


Heal 


See 
) vale 


. ee 
il ———~ dx. 
(11) i) Tyee dx 


(111) x (this is really a type considered in Problem 28). 


= | 
———. 
I xVl+x 


= 5 < “a 3 4 E - : 1 
he improper integral f". f is defined in the obvious way, as yim sen 


But another kind of improper integral f~\ f is defined in a nonobvious way: 
itis fy f + f-.. f, provided these improper integrals both exist. 


2OO 
ie) 


(a) Explam why f_. 1/(1 + x2) dx exists. 


, + : oO : . : N 
(b) Explain why f7) x dx does not exist. (But notice that hm f"y x dx does 
/ J—CO I iLag Aa, a 
exist.) 
b 2OO 5 é aN 5 Be é ate 2X) 
(c) Prove that if f_., f exists, then Jim iierm aro ds weil racine jy 


< é N41 -N : 
Show moreover, that lm [Sy 7 ad Lins y2 f both exist and equal 
N—>oo* N->oo i 
ool 5 : ; Fe A - 
ee f. Gan you state a reasonable generalization of these facts? (If vou 


can’t, you will have a miserable time trying to do these special cases!) 
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28. 


30. 


There is another kind of “improper integral” in which the imterval. is 


bounded, but the function is unbounded: 


(a) 


lt @ = Ogtmd him ["1//x dx. This limit is denoted by fj 1//x dx, 
et * 


even though the function f(x) = 1//x is not bounded on [0,a], no 
matter how we define f(Q). 

Find le x dem — |<; < 0. 

Use Problem 13-15 to show that {J x7! dx does not make sense, even as 
a limit. 

Invent a reasonable definition of le |x|’ dx for a < 0 and compute it for 
—-l<r<Q0. 

Invent a reasonable definition of je =i ee dasa Ot we 


eat wo ; . é 0 a 
limits, and show that the limits exist. Hint: Why does (ee (x) dx 


exist? How does (1 + x)~!/* compare with (1 — x?)7!/? for —1 < x < 0? 


x>O0F 


+ ae € ; (t) 
If f is continuous on [0,1], compute lim «| — dt. 
t 
x 


If f is mtegrable on [0,1] and continuous at 0, compute 


It is possible, finally, to combine the two possible extensions of the notion of 


the integral. 


(a) 


(b) 


Ife fic Sel eetorO ane < "1 and (Cs), =e Hore =e lewtanel 
‘he f (x) dx (after deciding what this should mean). 
0 


OO 
Show that x’ dx never makes sense. (Distinguish the cases —] < 
) . ° 
r <Qandr < —1. In one case things go wrong at 0, in the other case 
at 00; for r = —1 things go wrong at both places.) 
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CHAPTER 


THE TRIGONOMETRIC FUNCTIONS 


The definitions of the functions sin and cos are considerably more subtle than 
one might suspect. For this reason, this chapter begins with some informal and 
intuitive definitions, which should not be scrutinized too carefully, as they shall 
soon be replaced by the formal definitions which we really intend to use. 

In elementary geometry an angle is simply the union of two half-lines with a 
common initial point (Figure 1). 


ese eat 


ee 


FIGURE 1 


More useful for trigonometry are “directed angles,” which may be regarded as 
pairs (/;,/2) of half-lines with the same initial point, visualized as in Figure 2. 


GOI IS, 2 


If for 7; we always choose the positive half of the horizontal axis, a directed angle 
is described completely by the second half-line (Figure 3). 

Since each half-lne intersects the unit circle precisely once, a directed angle is 
described, even more simply, by a point on the unit circle (Figure 4), that is, by a 
point (x, y) with x? pay? — 1 
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The sine and cosine ofa directed angle can now be defined as follows (Figure 5): 
a directed angle is determined by a point (x, y) with x? + y? = 1; the sine of the 
angle is defined as y, and the cosine as x. 

Despite the aura of precision surrounding the previous paragraph, we are not 
yet finished with the definitions of sin and cos. Indeed, we have barely begun. 
What we have defined is the sine and cosine of a directed angle; what we want 
to define is smx and cosx for each number x. ‘The usual procedure for doing 
this depends on associating an angle to every number. ‘The oldest method is to 


“measure angles in degrees.” An angle “all the way around” is associated to 360, 
an angle “half-way around” is associated to 180, an angle “a quarter way around” 
to 90, etc. (Figure 6). ‘The angle associated, in this manner, to the number x, is 


called “the angle of x degrees.” The angle of 0 degrees is the same as the angle 
FIGURE 4 of 360 degrees, and this ambiguity is purposely extended further, so that an angle 
of 90 degrees is also an angle of 360 + 90 degrees, etc. One can now define a 
function, which we will denote by sm_, as follows: 


sin (x) = sine of the angle of x degrees. 


‘There are two difficulties with this approach. Although it may be clear what we 
mean by an angle of 90 or 45 degrees, it is not quite clear what an angle of V2 
degrees is, for example. Even if this difficulty could be circumvented, it is unlikely 
that this system, depending as it does on the arbitrary choice of 360, will lead 
to elegant results— it would be sheer luck if the function sm” had mathematically 


pleasing properties. 

“Radian measure” appears to offer a remedy for both these defects. Given any 
number x, choose a pomt P on the unit circle such that x is the length of the 
arc of the circle beginning at (1, 0) and running counterclockwise to P (Figure 7). 


The directed angle determined by P 1s called “the angle of x radians.” Since the 
length of the whole circle is 27, the angle of x radians and the angle of 27 + x 
FIGURE 5 radians are identical. A function sin’ can now be defined as follows: 


sin’ (x) = sine of the angle of x radians. 


This same method can easily be adopted to define sin ; since we want to have 
sin’ 360 = sin’ 27, we can define 


a ple ees 
S— Sil = sin" ——. 
(80 360 180 
We shall soon drop the superscript r in sin’, smee sin’ (and not sin’) is the only 
—--- function which will interest us; before we do, a few words of warning are advisable. 
‘The expressions sm x and sin” x. are sometimes written 
360 ce 
smn.x 
| sin. radians, 
| 
if 
i 
FIGURE 6 but dis notation is quite misleading; a number x is simply a number —it does not 


carry a banner imdicating that it is “in degrees” ov “i radians.” If the meaning 


length x 


FIGURE 7 
P 
length x 
Se: 
area 2 
FIGURE 8 
DEFINITION 


fo). x" 


area 


FIGURE 9 


| 
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of the notation “sm x” is in doubt one usually asks: 
“Is x in degrees or radians?” 
but what one means Is: 
“Do you mean ‘sin*’ or ‘sin’’?” 


Even for mathematicians, addicted to precision, these remarks might be dispens- 
able, were it not for the fact that failure to take them mto account will lead to 
incorrect answers to certain problems (an example is given in Problem 19). 

Although the function sin’ is the function which we wish to denote simply by sin 
(and use exclusively henceforth), there is a difficulty involved even in the definition 
of sin’. Our proposed definition depends on the concept of the length ofa curve. 
Although the length of a curve has been defined in several problems, it 1s also easy 
to reformulate the definition m terms of areas. (A treatment in terms of length ts 
outhned in Problem 28.) 


Suppose that x is the length of the are of the unit circle from (1, 0) to P; this are 
thus contains x/27 of the total length 27 of the circumference of the unit circle. 
Let S denote the “sector” shown in Figure 8; S is bounded by the unit circle, the 
horizontal axis, and the half-Hne through (0,0) and P. The area of S should be 
x /2z times the area inside the unit circle, which we expect to be z; thus S should 
have area 


We can therefore define cosx and sinx as the coordinates of the point P which 
determines a sector of area x/2. 

With these remarks as background, the rigorous definition of the functions sin 
and cos now begins. The first definition identifies 2 as the area of the unit circle 
more precisely, as twice the area of a semicircle (Figure 9). 


(This definition is not offered simply as an embellishment; to define the trig- 


onometric functions it will be necessary to first define sinx and cosx only for 
Os Te big 

The second definition is meant to describe, for —1 < x < 1, the area A(x) of 
the sector bounded by the unit circle, the horizontal axis, and the half-lme through 
ix, ¥ Wr), Tf O = x! < I, this area*ean be expressed (Figure 10) as the sum of 


the area of a triangle and the area of a region under the unit circle: 


oe mee | 
S| Voll uh dike 
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FIGURE 10 


DEFINITION 


GIO RS ete 


FIGURE 12 


DEFINITION 


‘This same formula happens to work for —1 <x <0 also. In this case (Figure 11), 


the term 
xa x 


» 


“~ 


is negative, and represents the area of the triangle which must be subtracted from 


the term 1 
/ / lh—2 ai. 
x 


If —1 <x <1,then 


Notice that if —1 <x < I, then A 1s differentiable at x and (using the Funda- 
mental ‘Theorem of Calculus), 


Aw) = 5 = | x2 a 
FL 252 ee x2) Ly/pe et 
Z ee 
Vane 5 


Notice also (Figure 12) that on the interval [—1.1] the function A decreases 


Ai) =0+ | Vi-Pdt= > 
=| PA, 


to A(1) = 0. This follows directly from the definition of A, and also from the fact 


from 


that its derivative is negative on (—1, 1). 

For 0 < x < @ we wish to define cosx and sinx as the coordinates of a point 
P = (cosx,sin x) on the unit circle which determines a sector whose area is x /2 
(Figure 13). In other words: 


If 0 <x <a, then cos x is the unique number in [—1, 1] such that 


A(cosx) = - 


sin x = /1 — (cosx)?. 


THEOREM 1 


PROOF 


P= (Cosx sine) 


x 
area — 
2 


FIGURE 13 
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This definition actually requires a few words of justification. In order to know 
that there 7s a number y satisfying A(y) = x/2, we use the fact that A is continuous, 
and that A takes on the values 0 and 2/2. This tacit appeal to the Intermediate 
Value ‘Theorem is crucial, if we want to make our preliminary definition precise. 


Having made, and justified, our definition, we can now proceed quite rapidly. 


If 0 =x < za, then 
cos (x) = —sinx, 
sin’ (x) = cos x. 
If B = 2A, then the definition A(cos x) = x/2 can be written 
B(Cos %)) = x. 


in other words, cos is just the inverse of B. We have already computed that 


l 
A‘(«~) == : 
2V1—-—x? 
from which we conclude that 
. | 
B(x)=- : 
1 — x2 
Consequently, 
cos’) = (B-')'(x) 
“ | 
Fis ®)) 
My | 
a. 1 
V1 — [Bap 
= —,/1 — (cosx)2 
= —sinx. 
Since 


sinx = J 1 — (cosx)2, 


we also obtain 


ae 1 —2cosx - cos’ (x) 
Sita (63) — : 
2 1 — (cosx)* 
cos x sin x 
sin x 
=cosx. J 


The information contained in Theorem | can be used to sketch the graphs of 
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ae 


FIGURE 14 


FIGURE 15 


sin 
f 
4 Eee 
2 
(a) 
e COS 


FIGURE 16 


sin and cos on the interval [0, 2]. Since 
COS (= — sin wa 0, BO eee o7, 


the function cos decreases from cos 0 = | to cosa = —1 (Figure 14). Consequently, 
cos y = 0 for a unique y in [0, z]. To find y, we note that the definition of cos, 


A(cosx) = ~ 
COSeG)! SS =. 
D 


means that 3 
A(O) = =, 
(Q) 5 


so 
a Vl =f dt. 
0 


It is easy to see that 


0 | 
| Ji=far= | Vb 42a 
=i 0 


so we can also write 


l 
a v1 SP dt = =. 
=) 
Now we have 
ae, IS Oy =< 70/2 
Sins(x).—=sGOS.% 
eae | 2 


so sin increases on [0, 2/2] from sin0 = 0 to sinz/2 = 1, and then decreases on 
[z/2, z| to sma = O (Figure 15). 

The values of sinx and cosx for x not in [0,z] are most easily defined by a 
two-step piecing together process: 


()) ater =o Zito 


sinx = —sin(2m — x), 
COSxX = cos — x). 


Figure 16 shows the graphs of sin and cos on [0, 27]. 


2) If x = 2mk +x’ for some integer k, and some x’ in [0, 277], then 
oS 


sinx = sinx’, 
cosx = cos x’. 


Figure 17 shows the graphs of sin and cos, now defined on all of R. 

Having extended the functions sin and cos to R, we must now check that the 
basic properties of these functions continue to hold. In most cases this is easy. For 
example, it is clear that the equation 


ey) 2 
sin- x + cos x = 1 
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sin 
20 An 
YA EOS 
t yl 
WA =F Ont tt 20 An 
(b) 
FIGURE 17 
holds for all x. It is also not hard to prove that 
sin’ (x) = cos x, 
cos (%) = —sin' x, 


if x is not a multiple of wz. For example, if 7 < x < 27, then 


sin x = —sin(2m7 — x), 
Se) 
Sino) s—=—sim' (2g = =) (— 1) 
= cos(27 — x) 
= GOSeL: 


If x is a multiple of 2 we resort to a trick; it is only necessary to apply Theo- 
rem 11-7 to conclude that the same formulas are true in this case also. 


See 1S) SS 
ies) 
FS 


wa 


[ \ 


| 
FIGURE 18 
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THEOREM 2 


IEG) OTR We) 


PROOF 


nw] a 


arcsin 


FIGURE 20 


The other standard trigonometric functions present no difficulty at all. We 


define 
] 
Sa — 
COE ae = loot tn 0, 
sin.x 
tanx = 
cos x 
| 
cou — 
sin X ; ; 
Be SoU are, 
cose a 
cot x = — 
sin.x 


The graphs are sketched in Figure 18. It is a good idea to convince yourself that 
the general features of these graphs can be predicted from the derivatives of these 
functions, which are listed in the next theorem (there is no need to memorize the 
statement of the theorem, since the results can be rederived whenever needed.) 


[ix em 4-2, en 


sec’(x) = sec x tan.x, 
, > 
tae) = SEC~ X. 


li x kar, them 


esc’ (x) = —csc x cot x, 


i 
Cot () = csc“ x. 
Left to you (a straightforward computation). J 


The inverses of the trigonometric functions are also easily differentiated. ‘Vhe 
trigonometric functions are not one-one, so it is first necessary to restrict them 
to suitable intervals; the largest possible length obtainable is 2, and the intervals 
usually chosen are (Figure 19) 


[—/2, 7/2|". for sin, 
[O. =] for cos, 
(—2/2,2/2) for tan. 


(The inverses of the other trigonometric functions are so rarely used that they will 
not even be discussed here.) 
The inverse of the function 


{ios x, —nmf/2<x<a21/2 


is denoted by aresin (Figure 20); the domain of aresin is [—1, 1]. “The notation 
Paes 1 ee ; ae rea. te 
sin has been avoided because arcsin is not the inverse of sim (which ts not one- 


one), but of the restricted function f; sometimes this function f is denoted by Sin, 


: || 
aud aresm by Sin. 


FIGURE 21 


BG Rk 23) ST OE Nas 
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The inverse of the function 
g(x) = 60s x? Une 77 


is denoted by arecos (Figure 21); the domain of arccos is [—1, |]. Sometimes g 
is denoted by Cos, and arccos by Cos !. 


The inverse of the function 
ime tall Xe —n/2<x <1/2 


is denoted by arctan (Figure 22); arctan is one of the simplest examples of a 
differentiable function which is bounded even though it is one-one on all of R. 
Sometimes the function / is denoted by Tan, and arctan by Tan”), 

The derivatives of the inverse trigonometric functions are surprisingly simple, 
and do not involve trigonometric functions at all. Finding the derivatives is a simple 
matter, but to express them in a suitable form we will have to simplify expressions 
like 


cos(arcsin x), sec(arctan x). 


arctan 


FIGURE 22 


A little picture is the best way to remember the correct simplifications. For exam- 
ple, Figure 23 shows a directed angle whose sine is x- the angle shown is thus an 
angle of (arcsin.x) radians; consequently cos(arcsin x) 1s the length of the other 
side, namely, V1 — x°. However, in the proof of the next theorem we will not 
resort to such pictures. 


iba = 1 then 


ey; | 
arcsin (x) = ————., 
ye 


—| 


fey, 


arccos (x) = 
Moreover, for all x we have 


arctan’ (x) = ———.. 
‘ceva 
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Gf 2)1@) 
| 
f'Gfo)) 
| 


. lA . 
sin (arcsin Xx ) 


| 


cos(arcsin x) 


PROOF arcsin (x) 


Now 
. . a) . 9) 
[sin(aresin x )|~ + [cos(aresin x )|* 

that is, 


x? + [cos(arcsin x)]* = 1; 


therefore, 
cos(arcsin x) = V1 — x2. 


(The positive square root is to be taken because arcsin x is in (—2/2, 7/2), so 
cos(arcsin x) > 0.) ‘This proves the first formula. 

The second formula has already been established (in the proof of ‘Theorem 1). 
It is also possible to imitate the proof for the first formula, a valuable exercise if 
that proof presented any difficulties. ‘The third formula is proved as follows. 


arctan’(x) = (h~!)'(x) 
| 
h'(h-!(x)) 
] 


tan’(arctan x ) 


9 
sec“ (arctan x) 


Dividing both sides of the identity 
On 2) 
Sina cos a — 1 


by cos? a yields 
9 9) 
tan’ a+ 1 =sec’ a. 
It follows that 


9 9 
[tan(arctan x)|“ + 1 = sec* (arctan x), 


or 


9) 9) 
x“ + 1 = sec*(arctan x), 


which proves the third formula. 


The traditional proof of the formula sin’(x) = cos x (quite different from the one 
given here) is outlined in Problem 27. This proof depends upon first establishing 


LEMMA 


PROOF 


THEOREM 4 
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the limit 
, sink 
lim =i, 
h-0 h 


and the “addition formula” 
sin(x + y) = sin x cos y + cos. sin y. 


Both of these formulas can be derived easily now that the derivative of sin and cos 
are known. The first is just the special case sin'(0) = cos0. The second depends 
on a beautiful characterization of the functions sin and cos. In order to derive this 
result we need a lemma whose proof involves a clever trick; a more straightforward 
proof will be supplied in Part TV. 


Suppose f has a second derivative everywhere and that 


f+ f=0, 
yi(O) 107 
Oy — 0) 


nen = U, 


Multiplying both sides of the first equation by _f’ yields 
f'f" + ff =0. 
Thus 
i ee 0 


so (f’)? + f? is a constant function. From f(O) = 0 and f’(0) = 0 it follows that 
the constant is 0; thus 


[FO + [Ff]? =0 for all x. 


This implies that 


if Gd) = 0 ior allxoi 


If f has a second derivative everywhere and 


eo 3 ? = 0, 
7 (0) =a" 
ek O—20., 


then 


f =b-sin+a-cos. 


(In particular, if f(0) = 0 and f’(0) = 1, then f =smn;if f(0) = land f’(0) = 0, 


then f = cos.) 
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PROOF Let 
g(x) = f(x) —bsinx —acosx. 


Then 
g(x) = f'(x) — bcosx + asinx, 
g(x) = f"(x) + bsinx + acosx. 
Consequently, 
” Bi g= (), 
g(0) =90, 
g(O)==10; 


which shows that 


0 = g(x) = f(x) — bsinx — acosx, for all x. 


THEOREM 5___I[f x and y are any two numbers, then 
sin(x + y) =sinx cos y +cosx sin y, 
cos(x + y) = cosx cos y — sin x sin y. 
PROOF _ For any particular number y we can define a function f by 


os) —sini(x + y). 


‘Then 
f’ (x) = cos(x + y) 
f(x) = —sin(x + y). 
Consequently, 
f" +f =0, 
FO) = siny, 
a0) =1eos iy 


It follows from Theorem 4 that 
f = (cos y) + sin +(sin y) - cos; 


that is, 
sin(x + y) = cos ysinx + sin ycosx, for all x. 


Since any number y could have been chosen to begin with, this proves the first 
formula for all x and y. 
The second formula is proved similarly. 


As a conclusion to this chapter, and as a prelude to Chapter 18, we will mention 
an alternative approach to the definition of the function sin. Since 


I 


ARCS Ch ye OR lee ne 


v1 — x? 
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it follows from the Second Fundamental Theorem of Calculus that 


arcsin x = arcsin x — arcsin 0 


ag ] 
= ——___— (jf, 
i v1—?# 


This equation could have been taken as the definition of arcsin. It would follow 
immediately that 


| 
Vie 


the function sin could then be defined as (arcsin)~! and the formula for the deriva- 


arcsin (x) = 


tive of an inverse function would show that 
bee? 5 
Si (0) — esi x. 


which could be defined as cos.x. Eventually, one could show that A(cos.x) = x/2, 
recovering at the very end of the development the definition with which we started. 
While much of this presentation would proceed more rapidly, the definition would 
be utterly unmotivated; the reasonableness of the definitions would be known to 
the author, but not to the student, for whom it was intended! Nevertheless, as 
we shall see in Chapter 18, an approach of this sort is sometimes very reasonable 
indeed. 


PROBLEMS 
1. Differentiate each of the following functions. 


(1) J @) =arctan (arclan( arctan) 2 
(it) f(x) = arcsin(arctan(arccos x)). 
Gui) f(x) = arctan(tan x arctan x). 


l 
ty ee 


2. Find the followimg limits by /Hopital’s Rule. 


Gv) f(x) = arcsin 


Bie: Soe Ses 


1 lim 
( ) x0 x3 
Gi) sinus — 6 
il it 
) vay, x4 


x0 x? 
7 Gosx — 1 4h2/2 
(iv) lim 
r>0 y 
arcean + oa + /3 
hh. 
x0 x 


er | | 
wi) lm |= —- 
x-O\xX  sinx 
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*i 


Let f@)=% yy ’ x#0 


(a) 
(b) 


fl. a"). 


Find) (0). 
Find f’(0). 


At this point, you will almost certainly have to use /H6pital’s Rule, but in 
Chapter 24 we will be able to find f ‘)}(Q) for all k, with almost no work 
at all. 


Graph the following functions. 


(g) 


pO) = si 2x, 
{= sin(x2). (A pretty respectable sketch of this graph can be ob- 
tained using only a picture of the graph of sin. Indeed, pure thought 
is your only hope in this problem, because determining the sign of the 
derivative f’(x) = cos(x2)-2x is no easier than determining the behavior 
of f directly. The formula for f’(x) does indicate one important fact, 
however— f’(0) = 0, which must be true since f is even, and which 
should be clear in your graph.) 
f(x) = sinx + sin 2x. (It will probably be instructive to first draw the 
graphs of g(x) = sinx and A(x) = sin 2x carefully on the same set of 
axes, from 0 to 27, and guess what the sum will look hke. You can 
easily find out how many critical pomts f has on [0, 277] by considering 
the derivative of f. You can then determine the nature of these critical 
points by finding out the sign of f at each point; your sketch will probably 
suggest the answer.) 
f(x) = tan x — x. (First determine the behavior of f in (—2/2, 2/2); m 
the intervals (ka — 2/2, km + 2/2) the graph of f will look exactly the 
same, except moved up a certain amount. Why?) 
f(x) = sinx —x. (The material in the Appendix to Chapter 11 will be 
particularly helpful for this function.) 

sin X 
f(x) = fa Ze 

Il rast). 


(Part (d) should enable you to determine approximately where the zeros 


of f’ are located. Notice that f is even and continuous at 0; also consider 
the size of f for large x.) 
i) = x<ip-x, 


The hyperbolic spiral is the graph of the function f(6) = a/@ in polar coordi 
nates (Chapter 4, Appendix 3). Sketch this curve, paying particular attention 


to its behavior for @ close to 0. 


Prove the addition formula for cos. 


Ts 


10. 


ihe 


(a) 
(b) 
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From the addition formula for sin and cos derive formulas for sin 2x, 
cos 2x, sin 3x, and cos 3x. 

Use these formulas to find the following values of the trigonometric func- 
tions (usually deduced by geometric arguments in elementary trigonom- 
etry): 


sin) ——cos | —— 


4 4 DS 
t gi | 
Al — wl 
4 
ci ] 
aia Ae 
A V3 
Oy SS —=- 
6 2 


Show that A sin(x + B) can be written as asinx + bcos x for suitable a 
and b. (One of the theorems in this chapter provides a one-line proof. 
You should also be able to figure out what a and bare.) 

Conversely, given a and b, find numbers A and B such that asin x + 
beosx — A sin(x%.-+- B) tor allix: 

Use part (b) to graph f(x) = V3 sin x + cosx. 


Prove that 
tan x + tan y 
tan(x + y) = ———————_ 
1 — tan x tan y 
provided that x, y, and x + y are not of the form kz + 2/2. (Use the 
addition formulas for sin and cos.) 


Prove that 


x+y 
arctan x + arctan y = arctan ier 5 
= 355 


indicating any necessary restrictions on x and y. Hint: Replace x by 
arctan x and y by arctan y in part (a). 


Prove that 


arcsin @ + arcsin B = arcsin(av 1 — p> + BV1—a? i) 


indicating any restrictions on @ and f. 


Prove that if m and n are any numbers, then 


[cos(m — n)x — cos(m + n)x], 
[sin(m + n)x + sin(m — n)x], 


[cos(m + n)x + cos(m — n)x]. 


sinmx sinnx = 
sin mx cosnx = 


COS MX COSHX = 


hl — hdl] bol 
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12. Prove that if m and n are natural numbers, then 


apie OF 7 en 
sin mx sinnx dx = 


TU. m=Nn, 


% 0; nan 
cosmx cosnx dx = 


aT, M=N, 


IT 
‘| sinmx cosnx dx = 0. 


It 


These relations are particularly important in the theory of Fourier series. Al- 
though this topic will receive serious attention only in the Suggested Reading 
(see reference [26]), the next problem provides a hint as to their importance. 


13. (a) If f is integrable on [—z, 2], show that the mmimum value of 
8 


(f(x) —acos nx)? dx 


occurs when 


| It 
a=— f(x) cosnx dx, 
IT S15 
and the minimum value of 
au 9 
ii (f(x) — asinnx)* dx 
ty 


when 


1 4 
a -| f(x)sinnx dx. 
TJ x 


(In each case, bring a outside the integral sign, obtaining a quadratic 
expression in d.) 


(b) Define 


p= -| TCS) COSMKGAX, je OPI 2a 
WU J—x 


] IU 
— -| HACG ISIN Oke en le De Once 
Mw J—x 


Show that if c; and d; are any numbers, then 


N 
Iv 
A CO : 
i f(x) - = + ) Cn COSNX + d, sINNX dx 


n=1 


N 2 N 
i ac co" 
=a / eG |? dx a OE ao at ae: = bndn Sipe > as ~~ Ge aF (a 


n=] n=l 


7 zy N 
= i, (f@yiedx = i a =f ar bho 


2) N 

a) ao Ss 2 2 

“1 J = Z | ai (Cn — An)” + (dn — bn)° 
/2 /2 n=! 


14. 


15. 


16. 


LC 


18. 


19. 


20. 


Zi 


225 
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thus showing that the first integral is smallest when a; = cj and bj = dj. 
In other words, among all “linear combinations” of the functions s,, (x) = 
sin ax and c,(x) = cosnx for 1 <n < N, the particular function 


N 
ag : 
ot a ai + ) a, cosnx + b, smnx 


n=1 


has the “closest fit” to f on [—z, z]. 


(a) Find a formula for sin x + sin y. (Notice that this also gives a formula for 
sin.x —siny.) Hint: First find a formula for sin(a +b) + sin(a — b). What 
good does that do? 

(b) Also find a formula for cosx + cos vy and cosx — cos y. 


a) Starting from the formula for cos 2.x, derive formulas for sin® x and cos* x 
a) Starting from the formula for cos 2x, derive formulas f id cos? 


in terms of cos 2x. 
(b) Prove that 


a 1 + cosx q Pe l —cosx 
Os = a sine — s —2__= 
c 5 5 1 n 5 5 


for Ole a7 2 
= a) 9) b ) 
{c) Use part (a) tafind { sm°xdx and {| cos- #dx. 
a a 
a 
(d) (Graph, f Gc) = sim x 
Find sin(arctan.x) and cos(arctan.x) as expressions not involving trigono- 


metric functions. Himtisy = arctan x meansethat w= aan y — sin y/ cosy 


a o 2) 
sin y/V 1 —sin’ y. 


If x = tanu/2, express sinu and cosu in terms of x. (Use Problem 16; the 
answers should be very sunple expressions.) 


(a) Prove that sin(x + 27/2) = cosx. (All along we have been drawing the 
graphs of sin and cos as if this were the case.) 
(b) What is aresin(cos x) and arccos(sin x)? 


| 
(a) tind f ———_— ite Hint: The answer ts not 45. 
0 


(b) wh dt. 
0 Paer2 + t2 


Find hm x sin — 
x00 x 


(a) Define functions sin® and cos’ by sin’(x) = sin(zx/180) and cos’ (x) = 
cos(ax/180). Find (sin’)’ and (cos’)’ in terms of these same functions. 


J 37 sit ara: 
(b) Find lim ang) hin sin —- 
x0 xX X00 Ay 


Prove that every pomt on the unit circle is of the form (cos@, sin @) for at 
least one (and hence for infinitely many) numbers 6. 
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FIGURE 24 


Dos 


24. 


ZO: 


“26, 


27 


(a) Prove that wz is the maximum possible length of an mterval on 
which sin is one-one, and that such an interval must be of the form 
[2ka —m/2,2kua +n/2] or [2kn +77/2, 2(k + 1)x —2/2]. 

(b) Suppose we let g(x) = sinx for x in (2ka — 2/2, 2ka + 2/2). What is 
Cie 

Let f(x) = secx for 0 < x < a. Find the domain of f~! and sketch its 


graph. 


Prove that | sin — sin y| < |x — y| for all numbers x 4 y. Hint: The same 
statement, with < replaced by <, is a very straightforward consequence of a 
well-known theorem; simple supplementary considerations then allow < to 
be improved to <. 


It is an excellent test of mtuition to predict the value of 


A> 


b 
tim f f(x) sinAxdx. 


Continuous functions should be most accessible to mtuition, but once you 
get the right idea for a proof the limit can easily be established for any inte- 
grable f. 
. : “ds c o ake 
(a) Show that lim f° sindx dx = 0, by computing the integral explicitly. 
A—> 90 ¢ 4 « 
(b) Show that if s is a step function on [a,b] (terminology from Prob- 
. ab Ss 
lem 13-26), then lm { Se) Sin Ary dx = 0: 
4-00 a 
; = 6 ba 3 x 
(c) Finally, use Problem 13-26 to show that lim J f(a)sm Ax dx = 10 for 
is A900 
any function f which is integrable on [a, b]. This result, like Problem 12, 
plays an important role in the theory of Fourier series: it is known as the 
Riemann-Lebesgue Lemma. 
This problem outlines the classical approach to the trigonometric functions. 


The shaded sector in Figure 24 has area x/2. 


(a) By considering the triangles OAB and OCB prove that if 0 < x < 7/4, 


then 
sin.x i smn.x 
z 2 2cosx- 
(b) Conclude that 
sin.x 
Gos se < 
a 
and prove that 
_ ‘siil.s 
lim =, |i 
>A) y 


(c) Use this lmnut to find 


*28. 


9. 


#30! 
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(d) Using parts (b) and (c), and the addition formula for sin, find sin’(x), 
starting from the definition of the derivative. 


This problem gives a treatment of the trigonometric functions in terms of 
length, and uses Problem 13-25. Let f(x) = V1 —x2 for -I < x < I. 
Define 2G )to"be the Tenethvot f on [xa 1); 


(a) Show that 


| 
LLCO) =| ———- dt. 
te ea 


(This is an improper integral, as defined in Problem 14-28, so you must 
first prove the corresponding assertion for the length on [x, | — e] and 
then prove that L(x) is the limit of these lengths as ¢ > O*.) 

(b) Show that 


l 


L£'(x) = - ——— ior —! =x = 
Vf lax 
(c) Define m as £(—-1). For 0 < x < m, define cosx by L(cosx) = x, and 


define sinx = V1 —cos2.x. Prove that cos’(x) = —sinx and sin’(x) = 


cos ¢4or @ <= <u, 


Yet another development of the trigonometric functions was briefly men- 
tioned in the text starting with inverse functions defined by integrals. It 
is convenient to begin with arctan, since this function is defined for all x. 
‘To do this problem, pretend that you have never heard of the trigonometric 
functions. 


(a) eta (a) = dru 4+ 1¢7)-! dt. Prove that a is odd and increasing, and that 
lim a(x) and hm = @(x) both exist, and are negatives of each other. If 


>) Somer Ae, @) a AOS. 
we define 7 = 2 lim a(x), then a7! is defined on (—2/2, 7/2). 
AC — 1G @) 


(b) Show that (a!Yajy= 14+ [at Gay| 
(c) Hor =2,/2..2790= 77/2 -deline tan 4 — a~'(x), and then define sinx = 


tanx/V 1+ tan?.x. Show that 


(1) lia sin 4 — al 
xon/2 
(11) lm  sinx =—1 
x—>—n/2+ 
sin.x 
ited Oo ——, —nm/2<x<2/2andx40 
(m) sin (x)= 4 tanx 
le ea!) 
(iv) sin"(x) = —sinx for —2/2 <x < 72. 


If we are willing to assuine that certain differential equations have solutious, 
another approach to the tigonometric functions is possible. Suppose, in 
particular, that there is some function yo which is not always 0 and which 
satisfies yo” + vo = 0. 
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BOL: 


Prove that yo” + (y0’)* is constant, and conclude that either yo(0) 4 0 
or yo (0) 4 0. 

Prove that there is a function s satisfying s” + s = 0 and s(O) = 0 and 
s‘(0) = 1. Hint: Try s of the form ayo + byo’. 


If we define sin = s and cos = s’, then almost all facts about trigono- 
metric functions become trivial. ‘Vhere is one point which requires work, 


however— producing the number z. This is most casily done using an 
exercise from the Appendix to Chapter 11: 


Use Problem 6 of the Appendix to Chapter 11 to prove that cos x cannot 
be positive for all x > 0. It follows that there is a smallest x9 > O with 
cos x9 = 0, and we can define 7 = 2xp. 

Prove that.sin 7/2 = J..(Since sin? + cos? = 1, we have sinz/2 = +1; 
the problem ts to decide why sin 2/2 ts positive.) 

Find cos 7, sinz, cos 27, and sin 27. (Naturally you may use any addi- 
tion formulas, since these can be derived once we know that sin’ = cos 
and cos’ = — sin.) 

Prove that cos and sin are periodic with period 27. 


After all the work involved in the definition of sin, tt would be discon- 
certing to find that sm is actually a rational function. Prove that it isn’t. 
(There ts a simple property of sin which a rational function cannot pos- 
sibly have.) 

Prove that sin isn’t even defined imphecitly by an algebraic equation; that 
is, there do not exist rational functions fo,.... 49 sual that 


(Sint) + foe) Gini)! +--+ fpr) =0 for all x. 


Hint: Prove that fo = 0, so that sin x can be factored out. ‘The remainmg 
factor 1s 0 except perhaps at multiples of 2. But this implies that it is 0 
for all x. (Why?) You are now set up for a proof by mduction. 


Suppose that @; and @2 satisfy 


oY + sig — 
d2" + g2¢2 = 0, 


and that go > g). 


(a) 


(b) 


Show that 
b1"b2 — 02") — (22 — 21) b1¢2 = 0. 


Show that if @)(+) > 0 and @2(x) > O for all x m (a,b), then 
b 


| [oir — o2"bi| > 9. 


a 


and conclude that 


[py '(b)p2(b) = oy (a \pr(a)| = [p(b)p2'(b) = pi (a)r (a)| = 0! 


OD: 


(c) 
(d) 


15. The Trigonometric Functions 323 


Show that in this case we cannot have ¢(a) = ¢1(b) = 0. Hint: Con- 
sider the sign of @,'(a) and ¢)'(b). 

Show that the equations ¢; (a) = ¢1(b) = 0 are also impossible if @, > 0, 
o2 < 0 or gd) < 0, 2 > 0, or @ < 0, d2 < 0 on (a,b). (You should be 


able to do this with almost no extra work.) 


The net result of this problem may be stated as follows: if a and b are 
consecutive zeros of 1, then ¢2 must have a zero somewhere between 
a and b. ‘This result, in a slightly more general form, is known as the 
Sturm Comparison Theorem. As a particular example, any solution of 
the differential equation 


y"+(x+ Dy =0 
must have at least one zero in any interval (#7, (a + 1)7). 


Using the formula for sin x — sin y derived in Problem 14, show that 
er | eo ia ee ee a 
sin(k + 5)x — sin(k — 5)x = 2sin 7 00 kx. 

Conclude that 


1 sin(n + 1) 
5 + Cosx + Cos 2x +++++cosnx = = Gago, 
“ 2 sin = 

2 
Like two other results in this problem set, this equation is very important 
in the study of Fourier series, and we also make use of it in Problems 19-43 
and 23-22. 


Similarly, derive the formula 


sinx + sin 2x +---+sinax = 


: n+l ; (" ) 
sin isin (| —x 
ae a 
x . 
2 


(A more natural derivation of these formulas will be given in Prob- 


lem 27-14.) 
b b 

Use parts (b) and (c) to find sinx dx and / cosx dx directly from 
0 0 


the definition of the integral. 


-CRAR LER: l6 JIS IRRATIONAL 


This short chapter, diverging from the main stream of the book, is included to 
demonstrate that we are already in a position to do some sophisticated mathemat- 
ics. ‘This entire chapter is devoted to an elementary proof that z 1s irrational. Like 
many “elementary” proofs of deep theorems, the motivation for many steps in our 


proof cannot be supplied; nevertheless, it is still quite possible to follow the proof 
step-by-step. 


Two observations must be made before the proof. The first concerns the func- 
tion 


r7(1 — x)" 


which clearly satisfies 
; ft aki 
0 =< FG) = 7 for 0) oye ll 
n! 


An important property of the function f/f, 1s revealed by considering the expression 
obtained by actually multiplying out x"(1 —x)”. ‘The lowest power of x appearing 
will be n and the highest power will be 2n. Thus f, can be written in the form 


2n 
i 
fr(x) = = ) CiX , 
nie 
=n 
where the numbers c; are integers. It is clear from this expression that 


fa (0) =Q0 ifk<nork >2an. 


Moreover, 


| : : 
ih Oe — [n! Cn + terms involving x | 
n! 


la) = —[(n + 1)!en41 + terms involving x 


n! 


| 

162) 

i os —[(2n)! con]. 
n! 
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This means that 


ie (0) = Cn, 
fa" 0) = (n Se Mere 


fr” 0) = Qn)Qn —1)-...- (2+ Dern, 
where the numbers on the right are all integers. ‘Thus 
fr (0) is an integer for all k. 


The relation 
fn(x) = fn(l — x) 
implies that 
i OSD i? as): 


therefore, 
far (1) is also an integer for all k. 


The proof that z is irrational requires one further observation: if a is any 
positive number, and ¢ > O, then for sufficiently large n we will have 


n 


— <€, 
n! 


To prove this, notice that if n > 2a, then 


qntl a a” leat 


SS <= + —, 
(n+1)! n+1 nr! 2 av! 
Now let nop be any natural number with no > 2a. Then, whatever value 


n 
a 0 


(no)! 


may have, the succeeding values satisfy 


qtr) 1] qo 
es < — =. 
(no +1)! 2 (no)! 
qot2) 1 qor 1) 1 1 q”0 


—_ + — 


Gp eae oo oe)! 22. Gant 


qtotk) l q”0 


(ng +k)! ~ Qk (no)! 
q”0 


< 2* then 


If k is so large that 
; no)! é€ 
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a (ng +k) 


(ng + k)! 


which is the desired result. Having made these observations, we are ready for the 
one theorem in this chapter. 


E, 


r . . ° . ive . . . . . . 

Phe number z is irrational; in fact, 7 is irrational. (Notice that the irrationality 
n fo ID . . ° . ~ ~ “cr . o} . 

of z~ implies the irrationality of 7, for if 2 were rational, then z~ certainly would 

be.) 


’ 5) . 
Suppose z~ were rational, so that 


for some positive integers a and b. Let 
(1) G(x) ABE kee (x) eT PAA) 4 gg Oe) 
S50 dk Ee y eres). 


Notice that each of the factors 


—k 
bly 2n—2k = b" (7)"* = pe (<)’ _ a'kpk 


is an integer. Since f,,“(0) and f,(1) are integers, this shows that 
G(Q) and G(1) are integers. 

Differentiating G twice yields 

OSG he a ef a) Po ey Cop 

The last term, (—1)" f,°°"+?)(x), is zero. Thus, adding (1) and (2) gives 

(3) G" (x) +2°G(x) = b"n*"? f(x) = 17a" f(x). 


Now let 
H(x) = G'(x)sinax — wG(x)cosxx. 


Then 


H'(x) = 2G'(x) cosmx + G’(x) sinax — 1G’ (x) cosmx + 27°G(x) sinax 
= [G"(x) +. 27G(x)] sin zx 
= ra" fa(x) sing. by @): 


By the Second Fundamental Theorem of Calculus, 


|| a” f,(x) sinax dx = H(1) — H(0) 
0 


= G'(1) sna — 21G(1) cosz — G’'(0) sin0 + 2 G(0) cosO 
x[G(1) + G(0)]. 


‘Thus 


| 
Pia et a aes ai 8 pital nee Lae 
xf a’ fy(x)smaxdx 1s an mleger. 
0 
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On: the othtershantdl (ee FG) =< Wa for Ol = Ise 


a 


fomOroen — eh. 


O =< 7a" fa(x)sintcx < 
n! 


Consequently, 


n! 


l n 
: ma 
Ore x | a" fy(x)sinax dx < —. 
0) 


‘This reasoning was completely independent of the value of n. Now if 1 is large 
enough, then 


| n 
ma 
Or 77 a” f,(x)sm ax dx < — < l. 
0 n! 
But this is absurd, because the integral is an integer, and there is no integer between 
r a . . o) scams . 
Q and 1. ‘Thus our original assumption must have been incorrect: 2 is irrational. J 


‘This proof is admittedly mysterious; perhaps most mysterious of all is the way 
that wz enters the proof—it almost looks as if we have proved z irrational without 
ever mentioning a definition of a. A close reexamination of the proof will show 
that precisely one property of z is essential — 


sin (ar) = 0; 


The proof really depends on the properties of the function sin, and proves the 
irrationality of the smallest positive number x with sinx = 0. In fact, very few 
properties of sin are required, namely, 


sin’ = cos, 

cos = —sin, 
sini O} 0) 
Gos (Oy) —aie 


Even this list could be shortened; as far as the proof is concerned, cos might just 
~ . / =| . ~ . . . ~ 

as well be defined as sin’. ‘The properties of sin required in the proof may then be 

written 


sin” + sin = 0, 
sin(O) = 0, 
sin’(O) = |. 


Of course, this is not really very surprising at all, since, as we have seen in the 
previous chapter, these properties characterize the function sin completely. 
PROBLEMS 


1. (a) Forthe areas of triangles OAB and OAC in Figure 1, with ZAOB < 7/4, 
show that we have 
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oY) Mea Gee 2 
Be oic = yo aera 


Hint: Solve the equations xy = 2(area OAB), x* + y* = 1, for y. 


(b) Let P,, be the regular polygon of m sides inscribed in the unit circle. If 
A,» 1s the area of P,, show that 


Ges) 7A 
\ pees =v 2 —2V1 — (2A /m)?. 


This result allows one to obtain (more and more complicated) expressions 
for Azn, starting with Ay = 2, and thus to compute 7 as accurately 
as desired (according to Problem 8-11). Although better methods will 
appear in Chapter 20, a slight variant of this approach yields a very 
interesting expression for 7: 


(FO), '€ 


FIGURE 1 Zsvve(a) Using the fact that 


area(OAB) _ 


=I 
area(OAC) 


show that if @,, is the distance from O to one side of P,,, then 


Aim 
= Am 
Adm 
(b) Show that 
D, 
= 4: Foo 5 Ow = 
Ao Ag Jk-1 


(c) Using the fact that 


IT 
Am = COS wt) 
m 


}1 S | 
and the formula cos x/2 = — (Problem 15-15), prove that 


16 = 


(S11 OF 
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‘Together with part (b), this shows that 2/7 can be written as an “infinite 


product” 
chau bsielalver Lape 
De ND De a Nee Ne 


to be precise, this equation means that the product of the first n factors 
can be made as close to 2/7 as desired, by choosing n sufficiently large. 
This product was discovered by Frangois Viete in 1579, and is only one of 
many fascinating expressions for 2, some of which are mentioned later. 


1 


2 


2 
== 


FIGURE 1 


*CHAPTER 


PLANETARY MOTION 


Nature and Nature’s Laws lay hid in night 
God said “Let Newton be,” and all was light. 


Alexander Pope 


Unhke Chapter 16, a short chapter diverging from the main stream of the book, 
this long chapter diverges from the main stream of the book to demonstrate that 
we are already in a position to do some real physics. 

In 1609 Kepler published his first two laws of planetary motion. The first law 
describes the shape of planetary orbits: 


The planets move in ellipses, with the sun at one focus. 


The second law involves the area swept out by the segment from the sun to the 
planet (the ‘radius vector from the sun to the planet’) in various time intervals 
(Figure 1): 


Equal areas are swept out by the radius vector in equal times. (Equivalently, the area 
swept out in time t is proportional to t.) 


Kepler’s third law, published in 1619, relates the motions of different planets. If a 
is the major axis of a planet’s elliptical orbit and T is its period, the time it takes 
the planet to return to a given position, then: 


The ratio a3 /T? is the same for all planets. 


Newton’s great accomplishment was to show (using his general law that the 
force on a body is its mass times its acceleration) that Kepler’s laws follow from the 
assumption that the planets are attracted to the sun by a force (the gravitational 
force of the sun) always directed toward the sun, proportional to the mass of the 
planet, and satisfying an inverse square law; that is, by a force directed toward 
the sun whose magnitude varies inversely with the square of the distance from the 
sun to the planet and directly with the mass of the planet. Simce force is mass 
times acceleration, this is equivalent simply to saying that the magnitude of the 
acceleration is a constant divided by the square of the distance from the sun. 

Newton’s analysis actually established three results that correlate with Kepler’s 
individual laws. The first of Newton’s results concerns Kepler’s second law (which 
was actually discovered first, nicely preserving the symmetry of the situation): 


330 


P3 
Ty 
P, 
ah 
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S 
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hepler’s second law ts true precisely for ‘central forces’, 1.e., if and only the force between 
the sun and the planet always les along the line between the sun and the planet. 


Although Newton is revered as the discoverer of calculus, and indeed invented 
calculus precisely in order to treat such problems, his derivation hardly seems to 
use calculus at all. Instead of considering a force that varies continuously as the 
planet moves, Newton first considers short equal time intervals and assumes that 
a momentary force is exerted at the ends of each of these intervals. 

‘To be specific, let us imagine that during the first time interval the planet moves 
along the line P; P2, with uniform velocity (Figure 2a). If} during the next equal 
time interval, the planet continued to move along this line, it would end up at 
P3, where the length of P; Px equals the length of P2P3. This would imply that 
the triangle $ P; P2 has the same area as the triangle SP) P3 (since they have equal 
bases, and the same height)—this just says that Kepler’s law holds in the special 
case where the force ts 0. 

Now suppose (Figure 2b) that at the moment the planet arrives at P2 it experi- 
ences a force exerted along the line from S to Pz, which by itself would cause the planet 
to move to the point Q. Combined with the motion that the planet already has, 
this causes the planet to move to R, the vertex opposite P2 m the parallelogram 
whose sides are P)P3 and PQ. 

Thus, the area swept out in the second time interval is actually the triangle 
SPR. But the area of triangle $P)R is equal to the area of triangle S$ P3 P2, since 
they have the same base SP, and the same heights (since R P3 is parallel to SP). 
Hence, finally, the area of triangle SP)R is the same as the area of the original 
triangle SP; P2! Conversely, if the triangle SRP has the same area as SP; P2, and 
hence the same area as S P3P2, then RP3 must be parallel to SP), and this implies 
that Q must lie along SP). 

Of course, this isn’t quite the sort of argument one would expect to find in a 
modern book, but in its own charming way it shows physically just why the result 
should be true. 


To analyze planetary motion we will be using the material in the Appendix to 
Chapter 12, and the “determimant” det defined in Problem 4 of Appendix 1 to 
Chapter 4. We describe the motion of the planet by the parameterized curve 


C(L) = FAN COs.0 (ey, Suro (rh): 


so that r always gives the length of the line from the sun to the planet, while @ 
gives the angle, which we will assume is increasing (the case where @ is decreasing 
then follows easily). It will be convenient to write this also as 


(1) C(t) =F )= e(O ia) y 


where 
e() = (cose sin 7) 


is Just the parameterized curve that runs along the unit circle. Note that 


e’(t) = (—sinf#, cost) 
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c(t) 
c(0) 
FIGURE 3 
c(t +h) 
c(t) 
O 
FIGURE 4 


is also a vector of unit length, but perpendicular to e(7), and that we also have 
(2) det(e(r), e’(t)) = 1. 

Differentiating (1), using the formulas on page 247, we obtain 
(3) c(t) =r'(t)-e(A(t)) + (a(t) - e(6(t)), 
and combining with (1), together with the formulas in Problem 6 of Appendix 1 
to Chapter 4, we get 
r(tyr’(t) det(e(@(t)), e(0(t))) + r(1)70'(t) det(e(@(1)), (A(t) 
= r(t)76'(t) det(e(O(1), e(A())), 


det(c(t), c(t) 


since det(v, v) 1s always 0. Using (2) we then get 
? 
(4) det(c,c’) = r°0’. 
As we will see, 776’ turns out to have another important interpretation. 

Suppose that A(f) is the area swept out from time 0 to t (Figure 3). We want 
to get a formula for A‘(t), and, in the spirit of Newton, we'll begin by making 
an educated guess. Figure 4 shows A(t +h) — A(t), together with a straight lne 
segment between c(t) and c(t-+/). It is easy to write down a formula for the area 


of the triangle A(/A) with vertices O, c(t), and c(t + 4): according to Problems 4 
and 5 of Appendix | to Chapter 4, the area 1s 


area(A(h)) = 5 det (c(t), c(t +h)— c@). 


Since the triangle A(/) has practically the same area as the region A(t+/h)— A(t), 
this shows (or practically shows) that 


ACL Ita Att) 


A’(t) = lim 
h—-0 h 
_ area A(h) 
= lim —————_- 
h—O h 
(t+h)— c(t 
= ! det (co. lim een) 
= h>0 h 


= 4 det(c(1), c'(1). 


A rigorous derivation, establishing more in the process, can be made using Prob- 
lem 13-24, which gives a formula for the area of a region determined by the graph 
of a function in polar coordinates. According to this Problem, we can write 


A(t) ; 
la) AGS | pip) dd 


A(0) 


if our parameterized curve c(t) = r(t) + e(@(t)) is the graph of the function p in 
polar coordinates (here we’ve used @ for the angular polar coordinate, to avoid 
confusion with the function @ used to describe the curve c). 
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Now the function p is just 
ioe ae) eo} 
[for any particular angle ¢, @7'(@) is the time at which the curve c has angular 
polar coordinate @, so r(@~!(t)) is the radius coordinate corresponding to ]. 
Although the presence of the inverse function might look a bit forbidding, it’s 


actually quite innocent: Applying the First Fundamental Theorem of Calculus 
and the Chain Rule to (*) we immediately get 


A(t) = 4p(0(t))* - 0'(t) 


= r(t)0'(t), SINGG@: — mo a7}. 


i)| 


Briefly, 


A’ = sr 6". 


5 det(c, c= 517". 


Now we’re ready to consider Kepler’s second law. Notice that Aepler’s second law 
is equivalent to saying that A’ is constant, and thus it is equivalent to A” = 0. But 


Ni hdl 


A" = 5[det(c. cy} det(c’, c’) + 5 det(c, ag) (see page 248) 


det(c, c”). 


So 


Kepler’s second law is equivalent to det(c, c”) = 0. 


Putting this all together we have: 


Kepler’s second law is true if and only if the force 1s central, and in this case each 
planetary path c(t) = r(t) - e(@(1)) satisfies the equation 


2) 
(K2) 7-0 =(det(e,c ) = constant, 


Saving that the force 1s central just means that it always points along c(t). Smee 
/ S ‘ I fe) 
c(t) is in the direction of the force, that is equivalent to saying that c(t) always 
points along c(t). And this 1s equivalent to saying that we always have 


det(c,c”) = 0. 


We've just seen that this is equivalent to Kepler's second law. 


5 , : ’ my! A a. wr: 
Moreover, this equation implies that [det(c, é )| = 0), which by (5) gives (K2). ff 
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c(t) 


THEOREM 2 


PROOF 


Newton next showed that if the gravitational force of the sun is a central force 
and also satisfies an inverse square law, then the path of any object in it will be a 
conic section having the sun at one focus. Planets, of course, correspond to the 
case where the conic section ts an ellipse, and this is also true for comets that visit 
the sun periodically; parabolas and hyperbolas represent objects that come from 
outside the solar system, and eventually continue on their merry way back outside 
the system. 


If the gravitational force of the sun is a central force that satisfies an inverse square 
law, then the path of any body in it will be a conic section having the sun at one 
focus (more precisely, either an ellipse, parabola, or one branch of an hyperbola). 


Notice that our conclusion specifies the shape of the path, not a particular param- 
eterization. But this parameterization is essentially determined by Theorem 1: the 
hypothesis of a central force implies that the area A(t) (Figure 5) is proportional 
to t, so determining c(t) 1s essentially equivalent to determining A for arbitrary 
points on the ellipse. Unfortunately, the areas of such segments cannot be deter- 
mined explicitly.* ‘This means that we have to determine the shape of the path 
c(t) = r(t)- e(@(t)) without finding its parameterization! Since it is the function 
ro@7! which actually describes the shape of the path in polar coordinates, we 
shouldn’t be surprised to find 6~! entering into the proof. 
By Theorem 1, the hypothesis of a central force implies that 


(K>) r-0' = det(c,c’) =M 


for some constant M. The hypothesis of an inverse square law can be written 


x e(j=- e(O(t)) 
(*) asaereey 
for some constant H. Using (K2), this can be written 
a eo) 
=—-—e 
0’(t) M 


Notice that the left-hand side of this equation 1s 
[co 8 "]/(A(t)). 


So if we let 
D=c'o ea! 


(this is the main trick --“we consider c’ as a function of 6”), then the equation can 
be written as 


6 1 e O [ ) —_— os@ I 5 Slll O I > 


* More precisely, we can’t write down a solution in terms of familiar “standard functions,” lke sin, 
arcsin, ete. 
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and we can write this simply as 
; H H lel. 
D'(u) = — —(cosu,snu) = | — — cosu, — —sinu 
M M M 


[for all w of the form @(t) for some t], completely eliminating 6. 
‘The equation that we have just obtained is simply a pair of equations, for the 
components of D, each of which we can easily solve individually; we thus find that 


H -sinu H -cosu 


for two constants A and B. Letting u = 6(t) again we thus have an explicit formula 
for’: 
; H -sin@ H -cos@ 
ae gp AY 
Stal M 


[Here sin 6 really stands for sino@, etc., abbreviations that we will use throughout.| 
Although we can’t get an explicit formula for c itself. if we substitute this equa- 
tion, together with ¢ = r(cos 4, sin @), ito the equation 


device yah (equation (K2)), 
we get 


He 5 13 alee . 
r|—cos°-6+ Bcosé + — sin’ #@ —Asin@é| = M, 
M M 


which simplifies to 
H B all § 
r| —~ + —cos@ — —sin@} =]. 
M- M M 


Problem 15-8 shows that this can be written in the form 
H 
r(t) EE + Ccos(@(t) + D) = d, 


for some constants C and D. We can let D = 0, since this simply amounts to 
rotating our polar coordinate system (choosing which ray corresponds to 6 = 0), 
so we can write, finally, 
9 
M- 


r| + ecos@] = fm AS 


But this is the formula for a conic section derived in Appendix 3 of Chapter 4 
(together with Problems 5, 6, and 7 of that Appendix). ff 
In terms of the constant M in the equation 
9 
ja ald 
and the constant A in the equation of the orbit 


rl ecosid]| = A 
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THEOREM 3 


the last equation in our proof shows that we can rewrite (x) as 


9) 


(*) C Maite TOE 


e(O(f)). 


Recall (page 87) that the major axis a of the ellipse is given by 


A 
(a) C= 
1 —¢ 
while the minor axis D is given by 
A 
(b) b= ———_—.. 
1 — ¢ 
Consequently, 
b? 
(c) Phir aie 
Remember that equation (5) gives 
A'(t) = 5r°6’ = 4M, 


and thus 
A(t) = 5Mt. 


We can therefore interpret M in terms of the period T of the orbit. This period T 
is, by definition, the value of t for which we have 6(t) = 27, so that we obtain the 
complete ellipse. Hence 


area of the ellipse = A(T) = 5MT, 


or 
2(area of the ellips 2ral 
eg CF Be SS) anf TE by Problem 13-17. 


Hence the constant M7/A in (**) is 


M2 o An2a~b* 


IN EGAN 


= ; using (c). 


This completes the final step of Newton’s analysis: 


Kepler’s third law is true if and only if the accelerations c”(t) of the various planets, 


moving on ellipses, satisfy 


| 
c(t) = —G - — e(6(t)) 


= 
r2 


for a constant G that does not depend on the planet. 


THEOREM 4 


PROOF 
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It should be mentioned that the converse of Theorem 2 is also true. To prove 
this, we first want to establish one further consequence of Kepler’s second law. 
Recall that for 


e(f) = (cost, sinr) 
we have 
e’(t) = (— sin, cosf). 
Consequently, 
e (ft) = (— cost, —sint) = —e(t). 
Now differentiating (3) gives 
e' (1) =r'(t) (e@()) +r OO) EO) 
+ r'(t)6'(t) - e'(O(t)) + (10 (2) - (2) + r(O'(1)6'(t) - e"(O(t)). 


Using e”(t) = —e(t) we get 
= [r") = (OO ] -e@@) + [2r' (HE'D + rH" (O] - (OD). 


Since Kepler’s second law imphes central forces, hence that c(t) 1s always a mul- 
tiple of c(t), and thus always a multiple of e(@(t)), the coefficient of e’(6(t)) 
must be QO [as a matter of fact, we can see this directly by taking the derivative of 
formula (K2)|. Thus Kepler’s second law mphes that 


(6) c(t) = [r'() — r(ty6'(t)7] - e(@(t)). 


If the path of a planet moving under a central gravitational force lies on a conic 
section with the sun as focus, then the force must satisfy an inverse square law. 


As in Theorem 2, notice that the hypothesis on the shape of the path, together 
with the hypothesis of a central force, which is equivalent to Kepler’s second law, 
essentially determines the parameterization. But we can’t write down an explicit 
solution, so we have to obtain information about the acceleration without actually 
knowing what it is. 

Once again, the hypothesis of a central force implies that 


(K>) ro’ = M, 


for some constant M, and the hypothesis that the path lies on a conic section with 
the sun as focus implies that it satisfies the equation 


(A) rill ecose| =A. 


for some € and A. For our (not especially illummating) proof, we will keep differ- 
entiating and substituting from these two equations. 
First we differentiate (A) to obtain 


r'[1+ecos@] — eré’ sind = 0. 
Multiplying by r this becomes 


rr’'{1 + ecos6] — er70’siné = 0. 
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Using both (A) and (K2), this becomes 
Ar’ —eMsiné = 0. 
Differentiating again, we get 
Ar” — €M@' cos@ = 0. 
Using (K2) we get 


and then using (A) we get 


Substituting from (K2) yet again, we get 


end 
Afr” —r(6')?] + 


or 


f= Foy == 
Ar2 


Comparing with (6), we obtain 


(6) = — = ep); 
c (t) neo 


which is precisely what we wanted to show: the force is inversely proportional to 
the square of the distance from the sun to the planet. J 


THE LOGARITHM AND 
CHAPTER EXPONENTIAL FUNCTIONS 


In Chapter 15 the mtegral provided a rigorous formulation for a preliminary def- 
mition of the functions sm and cos. In this chapter the mtegral plays a more 
essential role. For certain functions even a prelimimary definition presents difficul- 
ties. For example, consider the function 


i aa=io 


This function is assumed to be defined for all x and to have an inverse function, 
defined for positive x, which is the “logarithm to the base 10,” 
f-'(x) = logy x 
- — rSyll(0)> . 


In algebra, 10° is usually defined only for rational x, while the definition for ir- 
rational x is quietly ignored. A brief review of the definition for rational x will 
not only explain this omission, but also recall an important principle behind the 
definition of 10°. 

The symbol 10" is first defined for natural numbers n. This notation turns out 
to be extremely convenient, especially for multiplying very large numbers, because 


LO" ; 10” = GY ae 


The extension of the definition of 10* to rational x is motivated by the desire 
to preserve this equation; this requirement actually forces upon us the customary 
definition. Since we want the equation 


10° soe 10°*" = 10! 
to be true, we must define 10° = 1; since we want the equation 
1) Nees 


to be true, we must define 107" = 1/10"; since we want the equation 


1ol/" ee 19l/" = 410 l/nt+--+1/n = 10! = 10 
eee ee ee 
n times n times 
to be true, we must define 10!/" = Y10; and since we want the equation 
10!/" . . 19!/" ey) 1Q t/t t+l/n = 10"/" 
m times m times 


to be true, we must define 10”/” = (V10)". 
Unfortunately, at this pomt the program comes to a dead halt. We have been 
guided by the principle that 10* should be defined so as to ensure that 10°** = 


10°10"; but this prmeiple does not suggest any simple algebraic way of defining 
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10* for irrational x. For this reason we will try some more sophisticated ways of 
finding a function f such that 


(*) J Get y= f(xy 7) forall eand ¥. 


Of course, we are interested in a function which is not always zero, so we might 
add the condition f(1) 4 0. If we add the more specific condition f(1) = 10, 
then (*) will imply that f(«) = 10° for rational x, and 10° could be defined as f (x) 
for other x; in general f(x) will equal [f(1)]* for rational x. 

One way to find such a function is suggested if we try to solve an apparently 
more difficult problem: find a differentiable function f such that 


fx yy = foie fG) tor alley andy, 


Assuming that such a function exists, we can try to find f’ knowing the derivative 
of f might provide a clue to the definition of f itself. Now 


hl eee 
a 


h—0 h 
=i a F(x)- f(A) — f(x) 
 h0 h 
Cp) 1 
=a7O )- lm eles 
f=: h 
‘The answer thus depends on 
‘(hy 1 
ya) simi games 
h—0 h 


for the moment assume this limit exists, and denote it by a. ‘Then 
f ()=a- f(x) forall 


Even if a could be computed, this approach seems self-defeating. The derivative 
of f has been expressed in terms of f again. 

If we examine the inverse function f~! = logy. the whole situation appears in 
a new light: 


I 


a 
Bei FF 


a ffx) ax’ 


-! is about as simple as one could ask! And, what is even 


The derivative of f 
b 
more interesting, of all the integrals / x" dx examined previously, the mtegral 


a 
b 
i x! dx is the only one which we cannot evaluate. Since log;, 1 = 0 we should 
a 
have 


| ete 
=| a dt = log yy x — logy | = log jy x- 
l 


DEFINITION 


THEOREM 1 
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x 
This suggests that we define log,, x as (je) f t~' dt. The difficulty is that @ is 
] 


unknown. One way of evading this difficulty is to define 


Xx i 
logx = | = Oi, 
io 


and hope that this integral will be the logarithm to some base, which might be 
determined later. In any case, the function defined in this way 1s surely more 
reasonable, from a mathematical point of view, than log;g. The usefulness of 
log;g depends on the important role of the number 10 in arabic notation (and thus 
ultimately on the fact that we have ten fingers), while the function log provides a 
notation for an extremely simple integral which cannot be evaluated in terms of 
any functions already known to us. 


lf x > 0; then 


log x= [ 
1 


The graph of log is shown m Figure |. Notice that if x > I, then logx > 0, 
and if 0 < x < I, then log x < 0, since, by our conventions, 


xq ] | 
fl vd =~ | —dt < 0. 
ieee x f 


For x < 0, a number log x cannot be defined in this way, because f(t) = 1/t is 
not bounded on [x, I]. 


1 
A = — 
t 


area = log x log 


FUG RE al 


The justification for the notation “log” comes from the following theorem. 


ioxay =. 0, then 


log(xy) = log x + log y. 
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PROOF Notice first that log’(x) = 1/x, by the Fundamental Theorem of Calculus. Now 
choose a number y > O and let 


f (x) = log(xy). 
‘Then 


) | 
i OC) Sloe Gy) sy yy 
xy x 
Thus f’ = log’. This means that there is a number c such that 
f(@)=logx+c for allx >0, 


that is, 
log(xy) =logx +c _ forall x > 0. 


The number c can be evaluated by noting that when x = | we obtain 


log(1- y) =logl+c 


= C. 


Thus 
log(xy) =logx+logy for all x. 


Since this is true for all y > 0, the theorem is proved. J 


COROLLARY 1 If n is a natural number and x > O, then 


log(x") = nlog x. 
PROOF Let to you (use induction). § 


COROLLARY 2 If x, y > 0, then 
Xx 
log (=) = log x — log y. 
y 


PROOF This follows from the equations 


log x = log (= . ’) = log (=) + log y. 
y » 


Theorem | provides some important information about the graph of log. The 
function log is clearly increasing, but since log’(x) = 1/x, the derivative becomes 
very small as x becomes large, and log consequently grows more and more slowly. 
It is not immediately clear whether log is bounded or unbounded on R. Observe, 
however, that for a natural number n, 


log(2”) =nlog2 (and log2 > 0); 


it follows that log is, in fact, not bounded above. Similarly, 


| 
log (;:) = log 1 — log 2” = —n log 2; 
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therefore log is not bounded below on (0,1). Since log is continuous, it actu- 

. : . ; : | ae 
ally takes on all values. Therefore R is the domain of the function log". ‘This 
important function has a special name, whose appropriateness will soon become 
clear. 


DEFINITION The “exponential function,” exp, is defined as log™!. 


The graph of exp is shown in Figure 2. Since log x is defined only for x > 0, we 
always have exp(x) > 0. The derivative of the function exp is easy to determine. 


THEOREM 2 For all numbers x, 
J 
exp (9) = exp(x): 


PROOF exp’(x) = (log7!)/(x) = ee 
log (log “(x)) 
= l 
7 I 
log! (x) 


= log !(x) = exp(x). J 


A second important property of exp is an easy consequence of Theorem 1. 


THEOREM 3 If x and y are any two numbers, then 


exp + y) = exp) > expty). 


PROOF Let x= exp randy = expOe, so that 
f 
SS ee vee 
Boe 
Then 
x+y=logx’+logy = log(x’y’). 
‘This means that 


exp@ + y) =x y = exp(x).expQ). ff 


This theorem, and the discussion at the beginning of this chapter, suggest that 
OUR E 2 exp(1) is particularly important. There is, in fact, a special symbol for this number. 


DEFINITION | (B= oxo | 
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‘This definition is equivalent to the equation 


mal 
| =loge = f — dt. 
ih WZ 


OL I As illustrated in Figure 3, 
t 


P 
pal 

‘) —dt <1, smece 1 -(@-— 1) is an upper sum for 
ee 7) —ty ronnie 


and 


4 

l 
f[opare. since 4 -(2—1) + 4: (4-2) =1 is a lower 
Le Sum tor 7 (7) — lee om: |) 4), 


FIGURE 3 ‘Thus 


which shows that 


DC 


In Chapter 20 we will find much better approximations for e, and also prove that 
é 1s irrational (the proof is much easier than the proof that z is irrational!). 


As we remarked at the beginning of the chapter, the equation 
exp(x + y) = exp(x) - exp(y) 


implies that 


exp(x ) 


[exp(1)]" 


= e*, for all rational x. 


Since exp is defined for all x and exp(x) = e* for rational x, it is consistent with 
our earlier use of the exponential notation to define e* as exp(x) for all x. 


DEFINITION For any number x, 


e lexi): 


The terminology “exponential function” should now be clear. We have suc- 
ceeded in defining e* for an arbitrary (even irrational) exponent x. We have not 
yet defined a*, if a # e, but there is a reasonable principle to guide us in the 
attempt. If x is rational, then 


a= (els 4) ee loga” 


But the last expression is defined for all x, so we can use it to define a*. 


DEFINITION 
f(a) = 107 
\ \ | 
at \f@) = (5) 
\ x 
| ~*~ \ f (x) =e 
f(x) = (=) ‘ ; 
\ LQ =a 
— 
Bian oe = oa 
FIGURE 4 
THEOREM 4 
PROOF 
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If a > O, then, for any real number x, 


ak loga 


(If a =e this definition clearly agrees with the previous one.) 


The requirement a > 0 is necessary, m order that loga be defined. ‘This is not 
unduly restrictive since, for example, we would not even expect 


Gell? = of—1 


to be defined. (Of course, for certain rational x, the symbol a* will make sense, 
according to the old definition; for example, 


(Sime = = 1)) 


Our definition of a* was designed to ensure that 


(2) cen we for, alleaanid yy" 


As we would hope, this equation turns out to be true when e is replaced by any 
number a > 0. ‘The proof is a moderately mvolved unraveling of termmology. At 
the same time we will prove the other important properties of a“. 


Linders Oothien 
(1) (a’)° =a’ for all b,c. 


(Notice that a? will automatically be positive, so (a°)° will be defined); 


x W 


(2) a! =aanda*t? =a*-a’ forall x, y. 
(Notice that (2) imphes that this definition of a* agrees with the old one for all 


rational x.) 


(1) (ar) = et loga’ = ef logte""s*) = ech loga) _ ecb loga = a’. 


(Each of the steps in this string of equalities depends upon our last definition, or 


I) 


the fact that exp = log™ 


(2) a! = el loga = eloga a. 


ey elt ty) log ad — ox loga+yloga =: loga | eo loga 


= 0) oe 


Figure 4 shows the graphs of f(*) = a* for several different a. The behavior 
ofthentunctionsdependswonewhetherd < 1, a = |, orm > 1. If a = ty then 
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f@),= I=L. Suppose'a Sauls Inethisnease logae=n0 wal hus, 


if xe 
then xloga < yloga, 
fe e loga ue loga’ 


1.€., Cm 


Thus the function f(x) = a* is increasing. On the other hand, if 0 < a < I, 
so that loga < 0, the same sort of reasoning shows that the function f(x) = a* 
is decreasing. In either case, ifea = Qiand’a i, then’ f(y) — a is one-one 
Since exp takes on every positive value it is also easy to see that a* takes on every 
positive value. ‘Thus the inverse function is defined for all positive numbers, and 
takes on all values. If f(x) =a’, then f~! is the function usually denoted by log, 
(Figure 5). 

Just as a* can be expressed in terms of exp, so log, can be expressed in terms 


of log. Indeed, 


if 2 = log, bo 
then xr=a=e loga 
Sak los so. logx = yloga. 
ae ee 2 
1 a or ve 8 : 
es ; Es - 
ia = In other words, 
oe log x 
ee) a veyed eal 
log a 


The derivatives of f(x) = a* and g(x) = log. x are both easy to find: 
; S Sa , 


JOKER ONT e; 3) 


f(x) =e 84. 50 f(x) = loga-e* loga loga-a’, 
gixy=—=—, sog'(x)= 
ga 
A more complicated function like 
To) =20) 
is also easy to differentiate, if you remember that, by definition, 


f ( N= el ® log g(x), 


it follows from the Chain Rule that 


fe) = eNO OEE. W's) log g(x) +h (x) 2) 
§\X 


= ey” : fire log g(x) + GAS 2) . 


g(x) 


‘There is no point in remembering this formula —simply apply the principle behind 
it i any specific case that arises; it does help, however, to remeniber that the first 


factor in the derivative will be g(x)", 


THEOREM 5 


PROOF 
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‘There is one special case of the above formula which is worth remembering. 
The function f(x) = x“ was previously defined only for rational a. We can now 
define and find the derivative of the function f(x) = x for any number a; the 
result is just what we would expect: 


f(x) _ 4 — 78 log x 


sO 


a 7 
yt ae 1 
NG 


ef logx = 


iC) — 


a 
Re 
Algebraic manipulations with the exponential functions will become second na- 


ture after a little practice—just remember that all the rules which ought to work 
actually do. ‘The basic properties of exp are still those stated in ‘Theorems 2 and 3: 


ExOgca) —exnGn | 
exp(x + y= Exp(x) - exp(y). 
In fact, each of these properties comes close to characterizing the function exp. 
Naturally, exp is not the only function f satisfying f’ = f, for if f = ce*, then 
f'(x) = ce* = f(x); these functions are the only ones with this property, however. 


If f is differentiable and 
Hac ator allen, 
then there is a number c such that 


es = ce ior alls 


Let fx) 
g(x) =, 


e* 


(This is permissible, since e* ¥ 0 for all x.) ‘Then 


efpixn- fae 


/ 
g(x)= = (). 
g (x) (e*)2 
Therefore there is a number c such that 
3c) ' 
2@e) = is —le Borla, | | 
e 


The second basic property of exp requires a more involved discussion. The 
function exp 1s clearly not the only function f which satisfies 
Urey i" a (O)- 
In fact, f(x) = 0 or any function of the form f(x) = a” also satisfies this equation. 
But the true story is much more complex than this —there are infinitely many other 
functions which satisfy this property, but it is impossible, without appealing to more 
advanced mathematics, to prove that there is even one function other than those 
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EI Gi E 6 


THEOREM 6 


PROOF 


already mentioned! It is for this reason that the definition of 10* is so difficult: 
there are infinitely many functions f which satisfy 


J heey) — yO) ay), 
7 ENG; 


but which are not the function f(x) = 10°! One thing is true however 


any 
continuous function f satisfying 


PCa a) ty) 


must be of the form f(x) = a* or f(x) = 0. (Problem 38 indicates the way to 
prove this, and also has a few words to say about discontinuous functions with this 
property.) 

In addition to the two basic properties stated in Theorems 2 and 3, the function 
exp has one further property which is very important--exp “grows faster than any 
polynomial.” In other words, 


For any natural number n, 
3 


"aC 
hm — =oo. 
x00 x" 


‘The proof consists of several steps. 


Step 1. e* > x for all x, and consequently lm e* = oo (this may be considered 
26 NG, 2} 
to bethe’ case n7—.08 
‘To prove this statement (which is clear for x < 0) it suffices to show that 


x >logx foralla> 0. 


If x < | this is clearly true, since logx < 0. If x > 1, then (Figure 6) x — 1 is an 
upper sum for 7 @) ay on | | |i so low xy =< — 1 = ws. 


ae 


Siep.2, hm — =soo, 


(SASS) GE 


‘To prove this, note that 


a) 19 i) 
e* FER i oe | (ESS «2 
ae) ew. 
A aXe oe XG 
B a x 
2 2 
7 1 . . . . -{9 . 
By Step 1, the expression in parentheses is greater than |, and lim e*/* = oo; this 
aay 
shows that lim e*/x = oo. 
X—0O 
' 
: € 
Step 3. lim — =o. 
x—oo x" 


Note that 
ex (er/" y | e y/n 


x" r\4 ne X 
wok ey? = 
n i] 
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The expression in parentheses becomes arbitrarily large, by Step 2, so the nth 
power certainly becomes arbitrarily large. J 


It is now possible to examine carefully the following very interesting function: 


f(x) =e"! x £0. We have 


ae 
f@ael”. =: 


x- 

‘Therefore, 
i @) 10) stor. x= 0; 
if oy On torn = 0! 


so f is decreasing for negative x and increasing for positive x. Moreover, if |x| is 
'/x" is close to 1 (Figure 7). 


aye : x 
large, then x? is large, so —1/x? is close to 0, so e 


= 1+ = — 


——— a= 


FIGURE 7 
; 5 : : 6 ae 
The behavior of f near 0 is more interesting. If x is small, then 1/x~ is large, 


so e!/*" is large, soe !/* = 1/(e!/*’) is small. This argument, suitably stated with 


€’s and 4’s, shows that 


lime =0: 
x0 


‘Therefore, if we define 


rat Be x40 
OS |g. Os 


then the function f 1s continuous (Figure 8). In fact, f is actually differentiable 


FIGURE 8 
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at O: Indeed 


ew l/h l/h 
if (O) = iim = lim ——., 
h>0 h h>0 e(l/h)- 
and 
: L/h : x , l/h : x 
lim -~= lim —~, while lim ih = — lim — 
h—O+ e(l/hy- X—0O eX) h—>0- e(l/h)- x—0O ei) 


We already know that 


& fae 
lim — = co; 
X00 X 
it is all the more true that 
Z 
e& ) 
lim —— =o, 
Xx>00 X 
and this means that 
lim ='() 


Thus 


ee) = 


We can now compute that 


" ra: f'(h) =i f'(O) 
7 O)= iim So 


230 h 
ew lshe . 2 
3 
Nia h- 
h—0 
l 
a 2. en sh? ae Coors 7, 2x4 
= lim —— = lim —— = lim ——; 
h->0 h4 h—>0 el/he x—0co eX) 


an argument similar to the one above shows that f”(0) = 0. Thus 


oe =6 oe 
We Seem | s 
Os: ala MDE a 


0, a) 


This argument can be continued. In fact, using induction it can be shown (Prob- 
lem 40) that f(0) = O for every k. The function f is extremely flat at 0, and 
approaches 0 so quickly that it can mask many irregularities of other functions. 
kor example (Figure 9), suppose that 


f(x) = et Fi 
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It can be shown (Problem 41) that for this function it is also true that f“ (0) = 0 
for all k. ‘Vhis example shows, perhaps more strikingly than any other, just how 
bad a function can be, and still be infinitely differentiable. In Part IV we will 
investigate even more restrictive conditions on a function, which will finally rule 
out behavior of this sort. 


a 
a 


AC) = | 


eV’ sin L/x, x 40 
0, 


x —0 


FIGURE 9 


PROBLEMS 


1. Differentiate each of the following functions (remember that a” always de- 

notes a), 

A Sy 
(i) = f(x) = log(] + log(1 + log(l + eltelt)y). 
Gu) fs. Ginx) en 
(iv) FCS) = ein _ dt) ; 
eee) = jug). 
(vi) f(x) =log,,.) sin x. 

’ ay lc g(sin e*) 

wie yf i= Jaresin ( - )| ; 


sin x 
(viii) f(x) = dog(3 + e*))e* + (arcsin x)!°33. 
ix te — lor x ose, 

(x) f(x) =x". 
( 


See — si ah 


2. (a) Check that the derivative of logo f is f’/f. 


This expression is called the logarithmic derivative of f. It is often easier 
to compute than f’, since products and powers i the expression for f 
become sums and products m the expression for logo f. The deriva- 
tive f’ can then be recovered simply by multiplying by f; this process is 
called logarithmic differentiation. 


(b) Use logarithmic differentiation to find f’(x) for each of the following. 


i) fix)=(+4x)(1 +e"). 
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Giz x) tex2 
(—x)@G+.x)23° 


(111) Te) = (sin x)°S* + (cos x)", 


xX 


a) f@)= 


e* —e 


(iv) TGS) = Pages) 


Find 
b f (t) 


dt 
A af) 


(for f > 0 on [a, b)). 


Graph each of the following functions. 


(a) f(x) =e, 
(b) fx)= esx 
(ce) f@)aie ieee | (Compare the graph with the graphs of exp and 
(d) FES) = (Oo =O | / exp.) 
Ci meena = iI 2 
(€) L(x) ex +e-% am e2x | 7 ae e2x a ie 


Find the following limits by ’Hopital’s Rule. 


Spee (ws gee 2/9 
(ley oe 


x0 x? 
$3 ene 2 — 1/6 
(a) = ba ——__—_—__ 
x0 x3 
a =e SRD 
nr . 
ee We Aa 
log(1 —x+x?/2 
(iv) lim OS aa ere 
x0 x2 


(v) lm oe ia aia 2 ht /* ee 


x0 x3 
(vi) lm Sel 20) Se ig ea 2 +x) ax $x°/2 = x*/3 
x0 x3 ; 


Find the following limits by ’ Hopital’s Rule. 


i) km(1—x)!*. 
x 0 

Gi) lim (tan x)" 2x 
47 

(iii) lim (cos x) li, 


x0 


(x. y)ia?+y? = 1} 


(cos x, sin.x) 


(a) 


1 ye y= ca 


(cosh x, sinh x) 


ay 


(b) 


FIGURE 10 


the 
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‘The functions 


et —e-* 
sinh x = ———., 
2 
Gn +e * 
€osh x = —__—_, 
2 
e* —e* 2 
tanh x = ———— = | —- ———_., 
ex +e e-* + | 


are called the hyperbolic sine, hyperbolic cosine, and hyperbolic 
tangent, respectively (but usually read ‘smch,’ ‘cosh, and ‘tanch’). There 
are many analogies between these functions and their ordinary trigonometric 
counterparts. One analogy is illustrated in Figure 10; a proof that the region 
shown in Figure 10(b) really has area x /2 is best deferred until the next chap- 
ter, when we will develop methods of computing integrals. Other analogies 
are discussed m the following three problems, but the deepest analogies must 
wait until Chapter 27. If you have not already done Problem 4, graph the 
functions sinh, cosh, and tanh. 


Prove that 


le 


(a) cosh? — sinh? = 
(b) tanh? +1 / cosh” = 1. 

(c) sinh(x + y) = sinhx cosh y + cosh x sinh y. 
(d) cosh(x + y) = cosh x cosh y + smh x sinh y. 
(e) sinh’ = cosh. 

(f) cosh’ = sinh. 


l 


(g) tanh’ >. 
cosh7 


ss : : : ara a =| 
lhe functions sinh and tanh are one-one; their inverses smh and tanh ~, 
are defined on R and (—1, 1), respectively. ‘These inverse functions are some- 


‘ 


times denoted by arg sinh and arg tanh (the “argument” of the hyperbolic 

sine and tangent). If cosh is restricted to [0, 00) it has an inverse, denoted 
: asi) ee: : : 

by arg cosh, or simply cosh’ °, which is defined on [I}, 00). Prove, using the 


information m Problem 8, that 


(a) sinh(cosh7! x) = Vx? — I. 
(b) cosh(sinh~! vy=V14+x2. 
- “2 


| 
(c) (sinh7!)’(x) = ———— 
Vvl+x 
] 
(ay aeostin Cay] ————— fon =k 
ng? = | 
] 
Cen he) ee 


]—x- 
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10. 


iL Ne 


r2; 


13. 


14. 
15. 


16. 


(a) Find an explicit formula for sinh |, cosh |, and tanh! (by solving the 
equation y = sinh ' x for x in terms of y, etc.). 


(b) Find 


b 
] 
i ———— dx, 
a Vv 1+ x2 


b | 
ea > 


De] 
/ —— dx for |a|, |b| < 1. 
| —x- 


va 


dx torda,b> 1) ora,b < —s 


Compare your answer for the third integral with that obtained by writing 


Lola inde 
Pyar Oi Pay! eee 


x l 
Ho) — / aaa 
2 logt 


is not bounded on [2, ov). 


Show that 


Let f be a nondecreasing function on [1, 00), and define 


FG) fo dt, 


l 


te Ll. 


Prove that f is bounded on [1, 00) if and only if F’/ log is bounded on [1, 00). 
Find 


(a) lim a* for 0 <a < 1. (Remember the definition!) 
X— CO 


b) lm ——. 
2 x00 (log x)” 

] : n 
(c) lim Cog *) : 


x00 XG 1\" 
(aie (108 -| 
(d) lim xlorx)Rakint x(logx)”? = Se 


. x 
(e) ln. 


x—(0t 
Graph f(x) = x* for x > 0. (Use Problem 13(e).) 


(a) Find the minimum value of f(x) = e*/x” for x > 0, and conclude that 
LC) ie" ne Non = 1- 

(b) Using the expression f’(~) = e*(x — n)/x"*), prove that f’(x) > 
e"t1/(n + 1)"*! for x > n+ 1, and thus obtain another proof that 
lin, 7 () 00: 
¥—> 00 


Graph iG) =e yx 


7. 


18. 
19. 


20. 


20, 


ou. 
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(a) Find Hh log(1 + y)/y. (You can use PHopital’s Rule, but that would be 
silly.) 

(b) Find hm x log(] + 1/x). 

(c) Prove tlfat e= tim ( aed /x)*. 

(d) Prove that e@ = tim (1 +a/x)*. (It is possible to derive this from part (c) 


with just a little algebraic fiddling.) 


*(e) Prove that logb = lim x(b'/* — J). 


Graph f (c= (1 se | fre) Stor ee, (User Problem ‘1 7(@).) 


If a bank gives a@ percent interest per annum, then an initial investment / 
yields 1(1 + a/100) after 1 year. If the bank compounds the interest (counts 
the accrued interest as part of the capital for computing interest the next 
year), then the mitial investment grows to (1 + 4/100)" after n years. Now 
suppose that interest 1s given twice a year. ‘The final amount after ” years 
is, alas, not /(1 + a/100)?", but merely /(1 + a/200)*" —although interest is 
awarded twice as often, the interest must be halved mn each calculation, since 
the interest 1s a/2 per half year. “‘Vhis amount is larger than 7(1 + a/100)", 
but not that much larger. Suppose that the bank now compounds the interest 
continuously, Le., the bank considers what the investment would yield when 
compounding k times a year, and then takes the least upper bound of all 
these numbers. How much will an inital investment of | dollar yield after 
I year? 


(a) Let ff @) = leo |x|iter xt O08 Prove thatmy OsJ— a tore a0) 
(b) If fe). 0 for all x, prove thatlog. A) — fir. 


Suppose that on some interval the function satisfies =e} OL s@mic 
Suppose that t | the function f satisfies f’ yp oat 
number c. 


(a) Assuming that f is never 0, use Problem 20(b) to prove that | f (x)| = /e™ 
for some number / (> Q). It follows that f(x) = ke™ for some k. 

(b) Show that this result holds without the added assumption that f ts 
never 0. Hint: Show that f can’t be 0 at the endpoint of an open 
interval on which it is nowhere 0. 

(c) Give a simpler proof that f(x) = ke™ for some k by considering the 
Mimcuon, 98) = ji, va. 

(d) Suppose that f’ = fg’ for some g. Show that f(x) = ke8®? for some k. 


A radioactive substance diminishes at a rate proportional to the amount 
present (since all atoms have equal probability of disintegrating, the total 
disintegration is proportional to the number of atoms remaining). If A(r) 
is the amount at time ¢, this means that A’(t) = cA(t) for some ¢ (which 


represents the probability that an atom will disintegrate). 


(a) Find A(t) in terms of the amount Ag = A(Q) present at time 0. 
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235 


oo 


25. 


26. 


27. 


28. 


22. 


30. 


(b) Show that there is a number t (the “half-life” of the radioactive element) 


with the property that A(t+ 1) = A(t)/2. 


the difference of its temperature and the temperature of the surro 


Newton’s law of cooling states that an object cools at a rate proportional to 


unding 


medium, Find the temperature T(t) of the object at time 7, in terms of its 


temperature 79 at ume Q, assuming that the temperature of the surro 


unding 


medium is kept at a constant, M. Hint: ‘To solve the differential equation 


expressing Newton’s law, remember that 7’ = (T — M)’. 
x 
Prove thathiey (x) = i, VC) di tthen 7 =. 
0 


Find all continuous functions f satisfying 


0 
(ii) i . f alee 
0) 


I 
Find all functions f satisfying f’(1) = f(t) + La) de. 
0 


Find all continuous functions f which satisfy the equation 
i 
en 


(a) Let f and g be continuous functions on [a, b] with g nonnegative 
pose that for some C we have 


at. 


(f(x)? =| f(t) 
(6) 


De 
pect | fa, Qe xm b. 
a 
Prove Gronwall’s inequality: 


eg = Cela ®, 


>, Sup- 


Hint: Consider the derivative of the function h(x) = (C + if fa)e Je a 
(b) Let f and g be nonnegative functions with g continuous and f difleren- 


tiable. Suppose that f"(x) = g(x) f(x) and f(0) =0. Prove that 
(Compare Problem 21.) 


(a) Prove that 
se 3 n 


A 3 x ; ’ 
l+x+—+—4+-:-+—<e forx=0. 


Hint: Use induction on n, and compare derivatives. 
(b) Give a new proof that lim e*/x” = oo. 
X—>OC 


f =9. 


Give yet another proof of this fact, using the appropriate form of PH6pital’s 


Rule. (See Problem 11-56.) 
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4g 


31. (a) Evaluate lim ah ef dt. (You should be able to make an educated 
Xx->0O 


0 
guess before doing any calculations.) 
(b) Evaluate the following limits. 


ge pacrl/x) - 
(i) . lim e* | Ge dt. 
x 


X00 
, prtilogx)/x  , 
Gi) ime? | Pali. 
X00 
5 
see Os fox wy 
eee . re te 
(ii) lim e e at. 
X00 x 


32. ‘This problem outlines the classical approach to logarithms and exponentials. 
‘To begin with, we will simply assume that the function f(x) = a*, defined in 
an elementary way for rational x, can somehow be extended to a continuous 
one-one function, obeying the same algebraic rules, on the whole line. (See 
Problem 22-29 for’a direct proof of this.) The inverse of f will then be 

_denoted by log,. 


(a) Show, directly from the definition, that 
h l/h 
log, (x) = lim] 1+- 
Ce ae ae ie ( " | 
l {1 yI/k 
= —-log i hm(l +) : 
Xx k>0 


Thus, the whole problem has been reduced to the determination of 
lim(1 + h)!/". If we can show that this has a limit e, then log x)= 
h->0 
— -log,e = —, and consequently exp = log, | has derivative exp’(x) = 
aia. Xx 
eExp@): 


Ses 
(b) Let a, = {| 1+—) for natural numbers n. Using the binomial theorem, 
c 


show that 


a l 2 k—1 
> a('-- 1-=)....-(1- | 
k! n n n 
k=2 


Gonclude: thated,.= @;..1. 

(c) Using the fact that 1/k! < 1/2*~! for k > 2. show that all a, < 3. Thus, 
the set of numbers {a1, a2. a3,...} 1s bounded, and therefore has a least 
upper bound e. Show that for any ¢ > 0 we have e — a, < € for large 
enough n. ' 

(d) Ifn <x <a +1, then 


1 n l x 1 n+l] 
1+ ——]|] <[{I+-] <[1+= ; 
n+ ] x n 
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FIGURE 11 


+353 


SES 


ea? OO age dl ©,2) 


| x l X 
Conclude that lim (1 + =) =e. Also show that lim (1 + -) es 
: x iS 


and conclude that lim(1] + h)!/4 =e. 


h>0 


A point P is moving along a line segment AB of length 10’ while another 
point Q moves along an infinite ray (Figure 11). The velocity of P is always 
equal to the distance from P to B (in other words, if P(t) is the position of P 
at time ft, then P’(t) = 10’ — P(t)), while Q moves with constant velocity 
Q'(t) = 10’. The distance traveled by Q after time ¢ is defined to be the 
Napierian logarithm of the distance from P to B at time ¢. Thus 


10’t = Nap log[10’ — P(x). 


This was the definition of logarithms given by Napier (1550-1617) in his 
publication of 1614, Afirifici logarithmonum canonis description (A Description of 
the Wonderful Law of Logarithms); work which was done before the use of 
exponents was invented! The number 107 was chosen because Napier’s ta- 
bles (intended for astronomical and navigational calculations), listed the loga- 
rithms of sines of angles, for which the best possible available tables extended 
to seven decimal places, and Napier wanted to avoid fractions. Prove that 


10’ 
Nap log x = 10’ log —. 
as 


Hint: Use the same trick as in Problem 23 to solve the equation for P. 


(a) Sketch the graph of f(x) = (log x)/x (paying particular attention to the 
behavior near 0 and ov). 

(b) Which is lageenee Por 7°? 

(c) Prove that if 0 < x < 1, or x = e, then the only number y satisfying 
x” = y* iS yee but if x > 1, x 4 e, then there is precisely one number 
yi ZA satishane-¢= y*; moreover, if x < e, then y > ¢, andal x= 
then y < e. (Interpret these statements in terms of the graph in part (a)!) 

(d) Prove that if x and y are natural numbers and x” = y*, then x = y or 
M=2) =o — 4, y = 2. 

(ec) Show that the set of all pairs (x, y) with x” = y* consists of a curve and 
a straight line which intersect; find the intersection and draw a rough 
sketch. 


**(f) For 1 <x < e let g(x) be the unique number > e with x8 = g(x)". 


Prove that g is differentiable. (It is a good idea to consider separate 
functions, 
log x 


ED = , O= w= a 


log x 


CLSEY 


fra) = 


tO: 


36. 


of. 
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and write g in terms of fj and f>. You should be able to show that 


[g(x]? . loo x 


g(x) = 5 


~ 1 —log g(x) x 


if you do this part properly.) 


‘This problem uses the material from the Appendix to Chapter 11. 


(a) 
(b) 


(b) 


Prove that exp is convex and log is concave. 
H 


Prove that if = pi = | and all p; > 0, then for all z; > 0 we have 
il 
re Tae ee: nu =< p\Z\ a = Prec 

(Use Problem 8 from the Appendix to Chapter 11.) 

Deduce another proof that G, < A, (Problem 2-22). 


Let f be a positive function on [a, b], and let P,, be the partition of [a, b] 
into n equal intervals. Use Problem 2-22 to show that 


! ] 
SSS Ste Ro} = log (tu. r)) : 
-\b-a 


b—a 


Use the Appendix to Chapter 13 to conclude that for all ntegrable f > 0 


l b l b 
/ log f = log ( / f). 
b—-a Ja b-a Ja 


we have 


A more direct approach is illustrated in the next part: 


(c) 


In Problem 35, Problem 2-22 was deduced as a special case of the in- 


equality 
H n 
g (> na = ~~ Pig(xi) 
| ET 


n 
for p; > 0, ) pi = 1 and g convex. For g concave we have the reverse 
= 


inequality 
n fn 
pis Pie OG Ves 8 (> na 
tl =| 


Apply this with g = log to prove the result of part (b) directly for any 
integrable f. 


(d) State a general theorem of which part (b) is just a special case. 


Suppose f satisfies f’ = f and f(~«+y) = f(x) fQ) for all x and y. Prove 
thane e= expronya— 0. 
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*38. 


dee) 


*40. 


*41. 


42. 


mao: 


Prove that if f 1s continuous and f(x + y) = f(x) f(y) for all x and y, then 
either f = 0 or f(x)t="7 (9|* for alle rhnis Showthat 9G) eal) 
for rational x, and then use Problem 8-6. ‘This problem is closely related to 
Problem 8-7, and the information mentioned at the end of Problem 8-7 can 
be used to show that there are discontinuous functions f satisfying f(x+y) = 
FX) FO). 

Prove that if f is a continuous function defined on the positive real numbers, 
andey (4y) = f(x) af (yy for all positive x andeythentja—sOxorey Gj — 
f (e) log x for all x > 0. Hint: Consider g(x) = f(e*). 


Prove that if f(x) = en? for x #0, and f(0) = 0, then f® 0) = 0 fox 
all k (you will encounter the same sort of difficulties as in Problem 10-21). 
Hint: Consider functions g(x) = e7!/* P(L/x) for a polynomial function P. 


Prove that if f(x) = ex" sin 1/x for x £0, and f(0) = 0, then f“ (0) =0 


for all k. 
(a) Prove that if @ is a root of the equation 
(k)  @yx" + Ge ee a pe a) 
then the function y(x) = e® satisfies the differential equation 
(&%) oa Gyn? ++-»+ayy tagy = 0. 


*(b) Prove that if @ is a double root of («), then y(x) = xe also satisfies (*+). 
Hint: Remember that if @ is a double root of a polynomial equation 
| C—O athem af cc) = 0. 

*(c) Prove that if @ is a root of (*) of order r, then y(x) = x 
forO<k<x<r-l. 


k 


“pees 


is a solution 


If (x) has # real numbers as roots (counting multiplicities), part (c) gives 
n solutions yj,..., Yn Of (**). 


(d) Prove that in this case the function c,y; +--+ +¢n¥, also satisfies (*+). 


It is a theorem that in this case these are the only solutions of (**). Prob- 
lem 21 and the next two problems prove special cases of this theorem, 
and the general case is considered in Problem 20-26. In Chapter 27 we 
will see what to do when (x) does not have n real numbers as roots. 


Suppose that f satisfies f” — f =O and f(0) = f’(0) =0. Prove that f =0 
as follows. 
(a) Show that! f* — (f)* = 0. 


(b) Suppose that f(x) 4 0 for all x in some interval (a,b). Show that cither 
f(x) =e or alse’ {(@) = ¢er* ator all x imi, b); for some consianec 


**(c) If f(xo) 40 for x9 > 0, say, then there would be a number a such that 


0 < a= xpeandi f(a) = 0; while fx) 4 O for < * < x. Why? Usa 
this fact and part (b) to deduce a contradiction. 


#44, 


rer 


*46. 


Ai. 
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(a) Showathat af jusatisfies (/".— f = 0, then {/(4) = ae* + be™~ for 
some a and b. (First figure out what a and b should be in terms of f(Q) 
and f’(0), and then use Problem 43.) 


(b) Show also that f = asinh +b cosh for some (other) a and b. 


Find all functions f satisfying 


(a) me) = Gg). 
(b) yee a sy piyaoanle 


This problem, a companion to Problem 15-30, outlines a treatment of the ex- 

onential function starting from the assumption that the differential equation 
g | 

f' = f has a nonzero solution. 


(a) Suppose there is a function f 4 0 with f’ = f. Prove that f(x) 4 0 for 
each x by considering the function g(x) = f(xo + x) f(xo — x), where 
BMGs) =o 8, 

(b) Show that there is a function f satisfying f’ = f and f(O) = 1. 

(c) For this f show that f(w+y) = f(x): f(y) by considering the function 
g(x) = f(x + y)/f(). 

(d) Prove that f is one-one and that ae Gs.) = l/x. 


Let f and g be continuous functions such that lim f(x) = lim g(x) = oo. 
Ae eS) © Gorey Al ©, S) 


We say that f grows faster than g (f > g) if 


For example, for any polynomial function P with lim P(x) = oo (i.e, P 
X—> 0O 


is non-constant and has positive leading coefficient) we have exp >> P and 
P > log" for any positive integer 1. 


(a) Given f and g, with tim 16) e— bm (2) = co, Is it necessarily true 
that one of the three conditions a > g org > f or f ~ g holds? 
(b) If f > g, then f+g~ f. 
(cat 
log f 


log g 


C0 al 


for sufficiently large x, then f > g. 


(it Sees se ancdnt a fl f, Ga) = / g, does it necessarily follow 
0 JO 
that F > G? 
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(e) Arrange each of the following sets of functions in increasing order of 
growth (for convenience, we indicate each function simply by giving its 


value at x): 
(1) x? et, x3 + log(x3), log 4x, (log x)*, x*, x + e>*, x3 log x. 
n) «lo oe e>*, log(x*); ev x*, xlsx (log x)*. 
g 408 g 
(ail) Wewuneeee 2*, e*, (logan) =* 


48. Suppose that g1, g2, g3,... are continuous functions. Show that there is a 


continuous function f which grows faster than each g;. 


49. Prove that log), 2 is irrational. 


CHAPTER 9 INTEGRATION IN ELEMENTARY TERMS 


Every computation of a derivative yields, according to the Second Fundamental 
‘Theorem of Calculus, a formula about integrals. For example, 


if F(x) =og®)'— x thenie’y eae 


consequently, 


b 
[ togxax = FO) — Fla) = bllog) ~ b = [alloga) ~ a), OF a Bb 


a 
Formulas of this sort are simplified considerably if we adopt the notation 


b 
F(x)y|’ = F(b) — F(a). 


We may then write 
b 


b 
i} log xdx= x(logx) —x 


a 


fe : 5 b ° . 

lhis evaluation of {7° log x dx depended on the lucky guess that log is the deriva- 
tive of the function F(x) = x(logx)—x. In general, a function F satisfying F’ = f 
is called a primitive of f. Of course, a continuous function f always has a 


F(x) = i f, 


but in this chapter we will try to find a primitive which can be written in terms of 
familiar functions like sin, log, ete. A function which can be written in this way 


primitive, namely, 


is called an elementary function. ‘To be precise,* an elementary function is 
one which can be obtained by addition, multiplication, division, and composition 
from the rational functions, the trigonometric functions and their inverses, and the 
functions log and exp. 

It should be stated at the very outset that elementary primitives usually cannot 
be found. For example, there is no elementary function F such that 


P= efor all x 


(this is not merely a report on the present state of mathematical ignorance; it is 
a (difficult) theorem that no such function exists). And, what is even worse, you 


* The definition which we will give is precise, but not really accurate, or at least not quite standard. 
Usually the elementary functions are defined to include “algebraic” functions, that is, functions g 
satisfying an equation 


(ey + f_1Cate@yy | et fp =. 
where the fj are rational functions. But for our purposes these functions can be ignored. 
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will have no way of knowing whether or not an elementary primitive can be found 
(you will just have to hope that the problems for this chapter contain no misprints). 
Because the search for elementary primitives is so uncertain, finding one is often 
peculiarly satisfying. If we observe that the function 


loo(1 + x7) 
2 


Fig) sca retan x — 


satisfies 
F’(x) = arctan x 


(just how we would ever be led to such an observation is quite another matter), so 
that 


b 


log(| + x7) 


b 
Hl arctan ¥ dx = ee ARUN oe — 5 


a 
a 


ec bh) ob 
then we may feel that we have “really” evaluated f/ arctan x dy. 


This chapter consists of little more than methods for finding elementary prim- 
itives of given elementary functions (a process known simply as “integration”), 
together with some notation, abbreviations, and conventions designed to facilitate 
this procedure. This preoccupation with elementary functions can be justified by 
three considerations: 


(1) Integration is a standard topic im calculus, and everyone should know 
about it. 

(2) Every once in a while you might actually need to evaluate an integral, under 
conditions which do not allow you to consult any of the standard integral 
tables (for example, you might take a (physics) course in which you are 
expected to be able to integrate). 

(3) The most useful “methods” of integration are actually very important the- 


orems (that apply to all functions, not just elementary ones). 


Naturally, the last reason is the crucial one. Even if you intend to forget how 
to integrate (and you probably will forget some details the first ume through), you 
must never forget the basic methods. 

These basic methods are theorems which allow us to express primitives of one 
function in terms of primitives of other functions. ‘To begin integrating we will 
therefore need a list of primitives for some functions; such a list can be obtamed 
simply by differentiating various well-known functions. The list given below makes 
use of a standard symbol which requires some explanation. The symbol 


fy or [ sooas 


means “a primitive of f° or, more precisely, “the collection ofall primitives of f.” 
The symbol ff will often by used in stating theorems, while f{ f(x) dx is most 
useful in formulas hke the following: 


. a 
3 x 

xvodx=—. 
| 7 eo 


19. Integration in Elementary Terms 365 


This “equation” means that the function F(x) = x4/4 satisfies F’(r) = x7. Tt 
cannot be interpreted literally because the right side is a number, not a function, 
but in this one context we will allow such discrepancies; our aim is to make the 
integration process as mechanical as possible, and we will resort to any possible 
device. Another feature of the equation deserves mention. Most people write 


4 
[eastee 
4 


to emphasize that the primitives of f(x) = x? are precisely the functions of the 


form F(x) = x+/44+C for some number C. Although it is possible (Problem 14) 
to obtain contradictions if this point is disregarded, in practice such difficulties do 
not arise, and concern for this constant 1s merely an annoyance. 

There is one important convention accompanying this notation: the letter ap- 
pearing on the right side of the equation should match with the letter appearing 
after the “d” on the left stde—thus 


3 ut 
udu = —, 
4 
tx? 
(Xx ée SS SS, 
| ee 5 


, xt 
eG — a 7e 


A function in f f(x)dx, ie., a primitive of f, is often called an “indefinite 
integral” of f, while te f (x) dx is called, by way of contrast, a “definite integral.” 
This suggestive notation works out quite well in practice, but it is important not to 
be led astray. At the risk of boring you, the following fact is emphasized once again: 
the integral fe f(x) dx 1s not defined as “F(b) — F(a), where F is an indefinite 
integral of f” (if you do not find this statement repetitious, it is time to reread 
Chapter 13). 

We can verify the formulas in the following short table of indefinite integrals 
simply by differentiating the functions indicated on the right side. 


fe die On 


yrtl 
n is 
ed a . Ea 
atl 
| l ren dx . a. 
2) eas (a — dx 1s often written {| — for convenience; similar 
x x 
abbreviations are used in the last two examples of this 
table.) 
eas — ON 
[sv 26d aes GOS 


366 Derivatives and Integrals 


THEOREM 1 (INTEGRATION BY PARTS) 


COs. ax = Sines 
2) 
SEC A) aston 


Ssecx tan wax = sec x 


dx 
ex 
Gos 


Vile 


Two general formulas of the same nature are consequences of theorems about 


= arctan + 


a, 


Secs s 


differentiation: 


[iro + g(x)|dx.= ii f(x)dx + [ sooas. 


ic (x) dx = es fl FoMax. 


These equations should be interpreted as meaning that a primitive of f + g can 
be obtained by adding a primitive of f to a primitive of g, while a primitive of 
c- f can be obtained by multiplying a primitive of f by c. 

Notice the consequences of these formulas for definite integrals: If f and g are 
continuous, then 


b b 
finds + f eGadx. 


a a 


b 
/ [f(x) + a(x)] dx = 


b b 
/ erm @)ax =c- RG dx. 


a 

These follow from the previous formulas, since each definite integral may be writ- 
ten as the difference of the values at a and b of a corresponding primitive. Con- 
tinuity is required in order to know that these primitives exist. (Of course, the 
formulas are also true when f and g are merely integrable, but recall how much 
more difficult the proofs are in this case.) 

The product formula for the derivative yields a more interesting theorem, which 
will be written in several different ways. 


If f’ and g’ are continuous, then 


[ve = fg - | fs 
[ feos eas = f(x)g(x) — / f (etx jax, 
b b b 


i Wee CoNise 


a va 


Poe rds Sees) 


va 


(Notice that in the second equation f(+)g(x) denotes the function f + g.) 


PROOF 
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The formula 
Gi) = ji, emg 
can be written 


fg = (fa) — f'g. 


[se = fose’- [ rs. 


and fg can be chosen as one of the functions denoted by {(fg)’. This proves the 
first formula. 


‘Thus 


The second formula is merely a restatement of the first, and the third formula 
follows immediately from either of the first two. 


As the following examples illustrate, integration by parts ts useful when the func- 
tion to be integrated can be considered as a product ofa function f, whose deriva- 
tive is simpler than f, and another function which is obviously of the form g’. 


/ xe @dc=Kns= if |= gead % 
L1 Vy yy 
fg’ fg f~ 8 
= we* 9% 
[sin xdx = x -(—cosx) -— / 1 -(—cosx)dx 
Wed + J y + 
is Nf g am 8 


= —xcosx +sinx 


There are two special tricks which often work with integration by parts. ‘The 
first is to consider the function g’ to be the factor 1, which can always be written 


in. 
ii dx =| 


| -logxdx =x logx — / x (l/x)dx 
YY Lv LY 
ae eee Sane 


= x(logx) — x. 


The second trick is to use integration by parts to find fh in terms of fh again, 
and then solve for fh. A simple example is the calculation 


i! (1/x)-logx dx = logx -logx — i (l/x)- log x dx, 
y y y J J J 
gS By gf A Se; 


which implies that 


| 
2 | — loa es — (log x)? 
x 


368 Derwatives and Integrals 


or 


l 2) 
[ ytosxax = (log) ; 
De Ds 


A more complicated calculation is often required: 


[esin wax =e" > (Gcosn,) | — i e* -(— cosx) dx 


Val | ‘ y 1 
Wk ie g fe g 
= —e* cosx + [ e00s x dx 
Ay 
i we 
= —e* cosx + [e* - (sinx) — [etcin x) dx]; 
i) + eas! 
u v wie 
therefore, 
2 / e* sinx dx = e*(sinx — cosx) 
or 


2 


Since integration by parts depends upon recognizing that a function is of the 
form g’, the more functions you can already integrate, the greater your chances for 


oi e* (sin x — cos x) 
e sinx dx = —————_—__ 


success. It is frequently reasonable to do a preliminary integration before tackling 
the main problem. For example, we can use parts to integrate 


[oogxras = / (log x )(log x) dx 
y y 
ee 


if we recall that {log x dx = x(logx) — x (this formula was itself derived by inte- 
gration by parts); we have 


‘| (log x)(log x) dx = (log x)[x(log x) — x] — i (1/x)[x (log x) — x] dx 
y Y y 1 Y Y 
Fo 58 if g i g 
= (log x)([x(log x) — x] — [boss — 1] dx 


= (log x)(x(logx) —x]— [v8 ide | l dx 
(log x)[x (log x) — x] — [xdogx) — x] +x 


= x(logx)? — 2x (log x) + 2x. 


The most important method of integration is a consequence of the Chain Rule. 
The use of this method requires considerably more ingenuity than integrating by 
parts, and even the explanation of the method is more difficult. We will therefore 
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develop this method in stages, stating the theorem for definite integrals first, and 
saving the treatment of indefinite integrals for later. 


THEOREM 2 If f and g’ are continuous, then 
(THE SUBSTITUTION FORMULA) e(b) b 
=| UU ogg 
&la) a 
g(b) b 
fwdu= eC e CY. 
g(a) a 


PROOF If F is a primitive of f, then the left side is F(g(b)) — F(g(a)). On the other 
hand, 
(hog) = (Pr om) pe (fo 2) te", 


so F o g is a primitive of (f o g)- g’ and the right side is 


(F og)(b) — (F og)(a) = F(g(b)) — F(g(a)). J 


The simplest uses of the substitution formula depend upon recognizing that a 
given function is of the form (f 0 g)- g’. For example, the integration of 


b b 
i; sin? X GOS X dx ( = i (sin x) COS X ar) 
a a 


is facilitated by the appearance of the factor cos.x, which will be the factor g’(x) 
for g(x) = sinx; the remaining expression, (sin x), can be written as (g(x)P = 


mH (g(x )), Hor ftw =. Thus 


fi be 9 a 
Sin X COS. a4 
a f(®)= = u> 


b g(b) 
Cae ee = fu) du 
a g(a) 
sin b 5 sn°b  sin®a 
= ee = - , 
sina 6 6 


nee ‘ ab i f , 
Phe integration of f, tan.x dx can be treated similarly if we write 


b oe sit) ¥ 
tanxdx = — ———. dx. 
a a COS x 


In this case the factor — sinx is g’(x), where g(x) = cos.x; the remaining factor 
1/ cosx can then be written f(cosx) for f@) = b/u. Monee 


b g(x) = cosx 
i tanxdx : l 
a a (u) = — 


ul 


b g(b) 
ng eee 4) fu) du 
g 


(a) 


a 


cosb 
= -| — du = log(cos a) — log(cosb). 
¢ 


[OS a u 
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Finally, to find 


lee | 
/ ax, 
ee OO 


notice that 1/x = g’(x) where g(x) = logx, and that 1/logx = f(g(x)) for 
f@ =e Thus 


bg eg) Slog x 
il dx 
PK IOSX% fu) =- 
u 
b g(b) 
= | S@@)): @)dx = f(u) du 
@ g(a) 


logb 
= i — du = log (log b) — log(log a). 
] 


og a 
Fortunately, these uses of the substitution formula can be shortened considerably. 
The intermediate steps, which involve writing 


b 2(b) 


f(g(x))g'(x) dx = f(u) du, 


a g(a) 


can easily be eliminated by noticing the following: ‘To go from the left side to the 
right side, 


u for g(x) 


substitute ; 
du for g(x) dx 


(and change the limits of integration); 


the substitutions can be performed directly on the original function (accounting 
for the name of this theorem). For example, 


b : sin b 
AG : u for sinx 
/ sin> x cos x dx substitute = udu, 
a 


du for cosx dx nae 


and similarly 


ee ; u for cos x a 
dx | substitute Z = — du. 
A 1COSK du for —sinx dx , u 


‘OS a 


Usually we abbreviate this method even more, and say simply: 


whet a= 2%) 
au = 2 (%)\ due 


Thus 
b 4 lee w=lor% logb ] 
i dx l = i Sls 
4, wlogx du = —ax loga U 
. 
In this chapter we are usually interested in primitives rather than definite in- 


tegrals, but if we can find f”’ f(x) dx for all a and b, then we can certainly find 
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| f(x)dx. For example, since 


£16 516 
sin b sin a 


b 
cn 5) 
Sill COS as — ; 
f 6 6 


it follows that 


sin® x 


[ sin’ cosas = r 


Similarly, 


[rans dx —— logicos. 


1 
i dx = log(log x). 


x log x 


It is quite uneconomical to obtain primitives from the substitution formula by first 
finding definite integrals. Instead, the two steps can be combined, to yield the 
following procedure: 


Gy) et 
u = g(x), 
du a (a )\alee 


(after this manipulation only the letter wu should appear, not the 
letter x): 

(2) Find a primitive (as an expression involving u). 

(3) Substitute g(x) back for uw. 


Thus, to find 
/ sin? x cos X an 


(1) let 


“i Six. 
Gk = Cosx ax% 


fu du; 


so that we obtain 


(2) evaluate 


(3) remember to substitute sinx back for uw, so that 


“6 
5 sin x 
Sin sx’ COSX a= oe 
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Similarly, if 


u =logx, 
| 
ON == (18 
¥ 
then 
| I 
——dx becomes — du — loo w, 
x log x u 
so that 


| 
/ eee — Op ogy): 


x log x 


‘To evaluate 


% 
dx, 
i 1 +x? J 
let 
b= 1 xe: 
du =2x dx: 


the factor 2 which has just popped up causes no problem—the integral becomes 


i ipa 
sf: Hee ole @ 


7a 


se) 


x l 
De" de = alog(lceae): 
‘preg: Se atl 


(This result may be combined with integration by parts to yield 


2 
ih I - arctan x dx = x arctan x — (| at 
+ x 


= x arctan x — 5 log(1 + x0) 


a formula that has already been mentioned.) 

These applications of the substitution formula* illustrate the most straight- 
forward and least interesting types—once the suitable factor g’(x) is recognized, 
the whole problem may even become simple enough to do mentally. ‘The following 
three problems require only the information provided by the short table of indefi- 
nite integrals at the beginning of the chapter and, of course, the right substitution 


* The substitution formula is often written in the form 
[ fend a f(g(x))g'(x) dx, u=g(x). 


This formula cannot be taken literally (after all, { f(w) du should mean a primitive of f and the 
symbol f{ f(g(x))g’(x)dx should mean a primitive of (f © g) - g’; these are certainly not equal). 
However, it may be regarded as a symbolic summary of the procedure which we have developed. If 
we use Leibniz’s notation, and a little fudging, the formula reads particularly well: 


au 
[ ro au = [ pw far. 
: dx 
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(the third problem has been disguised a little by some algebraic chicanery). 
i) sec” x tan? x dx, 


[ (cos So Ce oe 


er 
i ee ax 5 


If you have not succeeded in finding the right substitutions, you should be able to 
six’ and arcsin e*. At first you 
may find these problems too hard to do in your head, but at least when g is of the 


euess them from the answers, which are (tan® x) /6, e 


very simple form g(x) = ax +6 you should not have to waste time writing out the 
substtution. The following integrations should all be clear. (The only worrisome 
detail is the proper positioning of the constant—should the answer to the second be 


3x dx = 


e** /3 or 3e**? T always take care of these problems as follows. Clearly fe 
e**. (something). Now if I differentiate F(x) = e3*, I get F’(x) = 3e3", so the 


“something” must be hs to cancel the 3.) 


dx 
= apes | 
/ a log(x + 3), 


3x 
es 

{= dx = —, 
3 


sin 4x 
/ cos 4x dx = : 


4 
— cos(2x + 1 
[ snes +1)dx= HONE 
aux arctan 2 
eae > Z 


More mteresting uses of the substitution formula occur when the factor g’(x) 
does not appear. ‘There are two main types of substitutions where this happens. 


] x 
/ abi ~ dx. 
| -—e* 


‘The promment appearance of the expression e* suggests the stmplifying substitu- 
| a dé fe) 


Consider first 


tion 


hose 
du =e“ dx. 


We therefore obtain 
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which can be evaluated by the algebraic trick 


[ e ga= f t pau = 21080 
a u= eae: t= —2100 (1) low: 


l—u 


so that 


l er . 
1 a dx = —2log(1 — e*) + loge* = —2log(1 — e*) + x. 
— e* = 


There is an alternative and preferable way of handling this problem, which does 
not require multiplying and dividing by e*. If we write 


baie; x = logu, 
l 

dx = —du, 
u 


then 


1+’ l l 
i Ws dx immediately becomes ‘| ate du. 
= se* LS 


Most substitution problems are much easier if one resorts to this trick of express- 
ing x in terms of u, and dx in terms of du, instead of vice versa. It is not hard to 
see why this trick always works (as long as the function expressing u in terms of x 
is one-one for all x under consideration): If we apply the substitution 


te — el), ~— g !(u) 
dx = (g-!)'(w) du 


to the integral 


[ fewnas, 


we obtain 
(1) | f(uy(g7! \'(u) du. 
On the other hand, if we apply the straightforward substitution 


W—2(%) 
aw = e"Geyiax 


to the same integral, 
I 
[ fewnas = / iE) PB See IG (CANCER 
g'(x) 
we obtain 


| 
2 i) re 
(2) [fm RGN 


The integrals (1) and (2) are identical, since (g~!)/(w) = 1/g/(g~!(u)). 
As another concrete example, consider 


oJ 
en 


———-. dx. 
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In this case we will go the whole hog and replace the entire expression ye* + | 
by one letter. Thus we choose the substitution 


u=vVJVerx+1, 
i see tk 
9 4) 
u-—l=e, x=log(u* —1), 
2u 
ae 


The integral then becomes 


eG Re? 3 
f[—, au du=2 fw —1du == —2u 
u 3 


ol 


Thus 


Dx @) e 
/ di say (ee (es eae 
Vex etal 3 


Another example, which illustrates the second main type of substitution that can 


[vi —x?dx. 


In this case, instead of replacing a complicated expression by a simpler one, we 


. : ae . 
will replace x by sinu, because ¥ 1 — sin°u = cosu. This really means that we 
are using the substitution vu = arcsin x, but it is the expression for x in terms of u 
which helps us find the expression to be substituted for dx. ‘Thus, 


occur, 1s the integral 


let 


| 


= sinw,) » [i = aresin'x | 
ax =COSuau: 


then the integral becomes 
cn) 9) 
Jv 1 —sm* u cosudu = [cos udu 


The evaluation of this integral depends on the equation 
1 + cos 2u 
2 
(see the discussion of trigonometric functions below) so that 


| ee -{[-S". weg tore BLS 
cos udu = 5 We 5 hn? 


2 
CoS’ u = 


and 


= arcsinx — sin(2 arcsin x) 
V1 —x2dx = ——— + ——_— 


2 4 


arcsima, «fly. ' : 
See 5 sin(arcsin x) - cos(arcsin x ) 


2 


arcsnx 1 ; 
Nl ne 


2 a 
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Substitution and integration by parts are the only fundamental methods which 
you have to learn; with their aid primitives can be found for a large number of 
functions. Nevertheless, as some of our examples reveal, success often depends 
upon some additional tricks. ‘The most important are listed below. Using these 
you should be able to integrate all the functions in Problems | to 10 (a few other 
interesting tricks are explained in some of the remaining problems). 


1. TRIGONOMETRIC FUNCTIONS 


Since 


ome? D, 
sin’ x + cos-x = | 


and 


2 39 
COS 2x = COS X —sSiIN-*X, 
we obtain 


4) 9 9) 
cos 2% ='cos’ x — (1 — cos’ x) =2 cos’ x — 1, 


oF FA) yn 4D) 0 8) 
cosZxy —(— sin- x):— sin x = | — 2 sin~ x. 


or 
Be l= "cos2x 
Aa aaa 
eos 
Coss 1 = =< ah eee 


These formulas may be used to integrate 


[ sn" xKdx. 
i! GOS aie 


(1 — cos 2x) (1 + cos 2x) 
LS or — SS 


Z pi 


if n is even. Substituting 


a? 5) 5 ‘ ‘ F 
for sin“ x or cos~ x yields a sum of terms involving lower powers of cos. For 
example, 


~ cos2x \? | | | 
[ sin’ BU Ca / (—S) Gls i qo — 5 | cos 2x dx + i | eo 2x dx 


and 
[cos 2xdax = if ee dx 


If n is odd, n = 2k + 1, then 


. e fy) E 
[ sv xdx = [sn x(1 — cos” x)‘ dx: 
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the latter expression, multiplied out, involves terms of the form sin x cos! caalaei 
which can be integrated easily. The integral for cos” x is treated similarly. An 
integral 


[sw x cos” x dx 
is handled the same way if n or m is odd. If n and m are both even, use the 


~ ae) 9 
formulas for sin“ x and cos? x. 
A final important trigonometric integral is 


I 
/ ee — [ sc x dx = log(sec x + tan x). 


COS X 


Although there are several ways of “deriving” this result, by means of the meth- 
ods already at our disposal (Problem 13), it is simplest to check this formula by 
differentiating the right side, and to memorize it. 


2. REDUCTION FORMULAS 


Integration by parts yields (Problem 21) 


. ] K = 1 PB 9 
[ sw" x dx === sin" | x coor + —— | sin” “xdx, 
n n 


] n—| 5 
i) cos" x dx = —cos"—! x sin x + —— | cos" “xdx, 
n Hn 


1 ole | x so | vi 
leer“ -ssaese 2n—2 J (x2+1)r-1 a 


and many stmilar formulas. The first two, used repeatedly, give a different method 
for evaluating primitives of sin” or cos”. The third is very important for integrating 
a large general class of functions, which will complete our discussion. 


3. RATIONAL FUNCTIONS 


Consider a rational function p/q where 


Day eate pe ee ee an. 
J ee By jx"! fmm, 


We might as well assume that a, = by, = 1. Moreover, we can assume that n < m, 
for otherwise we may express p/q asa polynomial function plus a rational function 
which is of this form by dividing (the calculation 
2} 
ur ] 


= | + —— 
u— | a a aiar 


is a simple example). The integration of an arbitrary rational function depends 
on two facts; the first follows from the “Fundamental Theorem of Algebra” (see 
Chapter 26, ‘Theorem 2 and Problem 26-3), but the second will not be proved in 
this book. 
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THEOREM 


THEOREM 


Every polynomial function 
GC) SX at Bin 1 ee ee 
can be written as a product 
i) Gey. era) n= epee) cin ei) 
(where ry + +++ +7, + 2(5] +--+ + 5)) =m). 
(In this expression, identical factors have been collected together, so that all 


Bs ae 
x —a; and x* + Bix + yj; may be assumed distinct. Moreover, we assume that each 
quadratic factor cannot be factored further. This means that 


P 
one Aor et) 
since otherwise we can factor 
2 2) 
2 Bete ee oe =pra Be = ai 
DE + Pier + Vi = x—-— ne x a = 
a 2 
into linear factors.) 
if «a < im and 
pix) =x" + dienett | +.---+tag, 


q(x) = x Dan ee | 
= (x — ay) e— a) (x? + Bix + 1) -... + Bax + yy)”. 


then p(x)/q(x) can be written in the form 
(x) a rei 
P(X) _ Ml . Sg i 
q(x) Soe Segoe 


Clo) CX Oy ee 


baxter) Diet Cie, 
(x? + Bix +71) (x? + Bix + yi)! 


Dp SCR 


Bis 8 =F Ci, s; 
| 
ior at) 


OE Bx Fy” 


This expression, known as the “partial fraction decomposition” of p(x)/q(x), is 
so complicated that it is simpler to examine the following example, which illustrates 
such an expression and shows how to find it. According to the theorem, it is 
possible to write 


2x! 4 8x® + 13x° + 2047 + 15x27 + 16x? + 7x + 10 


(x2 + x + 1202 + 2x + 2) — 1) 
a & b cx +d ext+f ex th 
Te Ceown ee aa ee ee (eo bee 12 
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To find the numbers a, b, c, d, e, f, g, and h, write the right side as a polynomial 
. 2 of 2 

over the common denominator (x- +. + 1)*(4- + 2x + 3)(x — 1)*; the numerator 

becomes 


ae — VG ee 2 Dy) ep eg A be 2) (x? Ee 
+ (ex. +.@)(x — 1)? (x2 tab)? Hex + AG — 17a? P2n4 DEAS e 4D 
+ (gx +h)(x = 1)? (x? 42% 4-2). 


Actually multiplying this out (!) we obtain a polynomial of degree 8, whose coef- 
ficients are combinations of a,...,4. Equating these coefficients with the coeffi- 
cients of 2x7 +8x5+ 13%°+20x7+ 15x34 16x2+7« + 10 (the coefficient of x° is 0) 
we obtain 8 equations in the eight unknowns a,...,/. After heroic calculations 
these can be solved to give 


a= |x 


b C 
e=0. f=). ge=0. += 1. 


‘Thus 


| Det Seo 13° 4 20xt = 17x? lox RIT 
a a eS ae 


(x2 4+ x + 1)2(x? + 2x + 2) — 1)? 


| i] ; +| e ; +| | 1 +| x+3 ; 
i a eg oe Ee 52 ae 
Ceol G— —2 : (2 44 x Ife ‘i se ee Ey ( 


(In simpler cases the requisite calculations may actually be feasible. I obtained this 
particular example by starting with the partial fraction decomposition and convert- 
ing it into one fraction.) 

We are already in a position to find each of the integrals appearing in the above 
expression; the calculations will illustrate all the difficulties which arise in integrat- 
ing rational functions. 


The first two integrals are simple: 


! 
/- j Ce togts — |), 


1 
2 —2 
—— dx = : 
fe x—- 1 


The third integration depends on “completing the square”: 


x +xtla(xt5y ti 


: : Ae 52 : k 
(If we had obtained —  istead of 4 we could not take the square root, but in this 


case our original quadratic factor could have been factored into near factors.) We 


380 = Derwatwes and Integrals 


can now write 


76 ] 
—.———~ dx $$ dx. 
(x? +--+ 1)4 ao) mag - 
- 5) 
=}4+1 
3 
4 
The substitution 
ee i 
“= =a 
wis. 
] 
du = —dx, 
5 
4 
changes this integral to 
16 J2 
— ee ae 
9 (u2 + 1)? 


which can be computed using the third reduction formula given above. 


/ x+3 q 
————— dx 
(2 +2 9} 


i x +3 fas 2x +2 «+ f 
nm 2 ta) ie a! oe acres | 


The first integral on the right side has been purposely constructed so that we can 


Finally, to evaluate 


we write 


evaluate it by using the substitution 


eet Oe 2" 
du = Ox +2) dx 


The second integral on the right, which 1s just the difference of the other two, 1s 
simply 2 arctan(x + 1). If the original integral were 


[ote Lees f= Vhs i es | 2 
dx G2 se |) == Se 
(x? + 2x + 2)" (x? + 2x +2)” Kae eee li 


the first integral on the right would still be evaluated by the same substitution. 
The second integral would be evaluated by means of a reduction formula. 

This example has probably convinced you that mtegration of rational functions 
is a theoretical curiosity only, especially since it is necessary to find the factorization 
of q(x) before you can even begin. This is only partly true. We have already seen 
that simple rational functions sometimes arise, as in the tegration 


1 J 
[ Sax: 
i keg 


another important example ts the mtegral 
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Moreover, if a problem has been reduced to the integration ofa rational function, 
it is then certain that an elementary primitive exists, even when the difficulty or 
impossibility of finding the factors of the denominator may preclude writing this 
primitive explicitly. 


PROBLEMS 


1. ‘This problem contains some integrals which require little more than alge- 
braic manipulation, and consequently test your ability to discover algebraic 
tricks, rather than your understanding of the integration processes. Never- 
theless, any one of these tricks might be an important preliminary step in 
an honest integration problem. Moreover, you want to have some feel for 
which integrals are easy, so that you can see when the end of an integration 
process is in sight. ‘The answer section, if you resort to it, will only reveal 
what algebra you should have used. 


/ p) r . . . 

(v) i! tan* x dx. (Irigonometric integrals are always very touchy, because 
there are so many trigonometric identities that an easy 
problem can easily look hard.) 


a / dx 
ie 1-+sin x 
8x2 ++6x +4 
(ix) if hae a A 
x+ 1 
| 
(x) [—S«. 
Vike 2 


2. ‘The following integrations involve simple substitutions, most of which you 
should be able to do in your head. 


(1) | e* sine’ dx. 


382 Derivatiwes and Integrals 


(11) fro dx 
l 
(111) fl O8* dx. (In the text this was done by parts.) 
x 
fot 
e7* + 2er + | 
(v) / e° e* dx 
a | ae 
v1l—x4 
fai) [Sa 
vil is 
Ve 


(vii) [i —x*dx. 
(1x) [ r9¢(0059 tan x dx. 


x) | log (log x) i 


x log x 


3. Integration by parts. 


(1) ae dx. 

(11) eve dx. 
(111) is e™ sin bx dx. 
(iv) / x? sinx dx. 
(v) [oogx dx. 


(vi) i ws 


x 
(vil) it sec? x dx. (This isa tricky and important integral that often comes 
up. If you do not succeed in evaluating it, be sure to 


consult the answers.) 


(viit) [ costogsydx, 
(1x) [ Ve 09 dx. 


(x) [ x00 a )Riax: 
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The following integrations can all be done with substitutions of the form 
x = sinu, x = cosu, etc. ‘To do some of these you will need to remember 
that 
/ seex'dx= log(see x -Htan x) 
as well as the followimg formula, which can also be checked by differentiation: 
/ csc x dx = — log(csc x + cot x). 

In addition, at this point the derivatives of all the trigonometric functions 
should be kept handy. 
- dx : ee 1 
(i) ————.. (You already know this integral, but use the substitution 

/ DP 

I—x° y = sin uw anyway, just to see how it works out.) 
aa dx a 7 5 2 
(11) ———.. (Since tan’ u + 1 = sec“, you want to use the substi- 

/ 2 

1+x° tution x = tan.) 
5. dx 
(111) 

x71 
: dx .e : aR ; 
(iv) ————.. (The answer will be a certain inverse function that was 
; LD: 0 Cf © 

xVx° — 1 given short shrift in the text.) 
() dx 
Vv = Sa, 
xv 1—x? 
dx 


joss oeey ae) i j 

(vn) xv 1 ~ x' dx. You will need to remember the methods for 
integrating powers of sin and cos. 

(viii) [vi — x2 dx. 


(1x) / V1+x2 die 
(x) / ec 


The following integrations involve substitutions of various types. ‘There is 
no substitute for cleverness, but there is a general rule to follow: substitute 
for an expression which appears frequently or prominently; if two different 
troublesome expressions appear, try to express them both in terms of some 
new expression. And don’t forget that it usually helps to express x directly 
in terms of u, to find out the proper expression to substitute for dx. 


: dx 
0) fs ey ee 


Gi) ‘i as 
Ww Tae 


384 Derivatives and Integrals 


6. 


a dx 
(11) / Ve ae 


sy dx 


. (The substitution u = e* leads to an integral requir- 
vite ing yet another substitution; this is all right, but both 


substitutions can be done at once.) 


dx 
a SS 
2+ tan x 
dx ae 
(vi) ————. (Another place where one substitution can be made to 


V/x+1 do the work of two.) 
Ar | 

(vii) ‘| ae aA : 7 dx. 

(viii) | aire, 


ies 
ive 


(ix) dx. (In this case two successive substitutions work out best; 
there are two obvious candidates for the first substitu- 


tion, and either will work.) 


Phy / x—-1 Ly 
x) Ce 


The previous problem provided gratis a haphazard selection of rational func- 
tions to be integrated. Here is a more systematic selection. 


2 Tal 
(i) [SS + 


xe4+x2—-x-1 


2x + 1 
il ———_—_—____—_——_ dx. 
(u) (SS _ 


x3 + 7x? —5x4+5 
ee OG 
(x = 1)27G4 1/2 
: Qx-+x+1 
——————— 

(x +3)@ — 1) 


x+4 
——— dx. 


xe+x+2 
re 
pee yo || 
3x243x4+1 
——_ sss IID Ge 
Kao eae | 
dx 


(111) 


aa 


FAs 


*8: 
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Find / — , which looks a little different from any of the previous 
Ve 

problems. Hint: It helps to write (x” —x)1/2 = x(x"-2—1)!/2, Extra Hint 1: 

Use a substitution of the form u? =... to obtain an answer involving arctan. 

Extra Hint 2: Use a substitution of the form y = x®% to obtain an answer 

involving arcsin. 


Potpourri. (No holds barred.) The following integrations involve all the 
methods of the previous problems 


5 arctan x 
— dx. 
0) | 1+ x? ‘. 


Gi x arctan x 
il a 
(1 + x*)2 


(111) [v8 V14+x2dx. 
(iv) ie log ¥1+ x2 dx. 


x l 
f Poehee | £ ———- d; . 
) [> Vile x : 
(v1) / arcsin /x dx. 


6 
& Sar 
vay) ls x : 


3 : 
- a COS sso 
(vil) i en”. ———_,—— dx. 
€as* X 


(ix) / Vtan x dx. 


dx a 
(x) i ay (To factor x® + 1, first factor y3 + 1, using Problem 1-1.) 
x 


The following two problems provide still more practice at integration, if you need 


it (and can bear it). Problem 9 involves algebraic and trigonometric manipulations 
and integration by parts, while Problem 10 involves substitutions. (Of course, in 
many cases the resulting integrals will require still further manipulations.) 


9. 


Find the following integrals. 
(i) [rose ase ido: 


(il) 
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Be) 
Sine edx: 


sec? x tan x dx. 


| 
| 

(vii) / x” arctan x dx. 
| 


(1x) 


(x) i x tan® x dx. 
10. Find the following integrals. 


dx 

0 fap 

(it) [vi —sinx dx. 

(111) / arctan ./x dx. 

(iv) sn Vx +1 dx. 
vyx3-2 

(v) f ——— dx. 

X 


: There are obvious substitutions to try, 
(vi) / log(x + vx? —1)dx. | put integration by parts is much easier. 


Comparing the answers obtained is, 
(vil) i log(x + Vx) dx. perhaps, instructive. 


ae dx 
(viil) / ECs 
(ix) [resin x) dx. 


(x) / x° arctan (x?) ax. 


11. If you have done Problem 18-10, the integrals (11) and (ii) in Problem 4 will 
look very familiar. In general, the substitution x = coshu often works for 


integrals involving ¥ x? — 1, while x = sinh w is the thing to try for integrals 
involving Vx? + 1. Try these substitutions on the other integrals in Prob- 
lem 4. (The method is not really recommended; it is easier to stick with 
trigonometric substitutions.) 

*12. ‘The world’s sneakiest substitution is undoubtedly 


2: 
x =2arctant, dx = ——~dt. 


t = tan 
ea 2. 


WN] & 


+13. 
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As we found in Problem 15-17, this substitution leads to the expressions 


: 2r S** i-g 

Se merry aes 
This substitution thus transforms any integral which involves only sin and 
cos, combined by addition, multiplication, and division, into the integral of 


a rational function. Find 


d. 
(1) i = (Compare your answer with Problem 1I(vi).) 


2 dx Ss 
(11) i aes 7 (In this case it is better to let t = tan. x. Why?) 
= Si Xx 


oe dx 
(111) — (There is also another way to do this, using 


oS a te ar ern 15-8.) 


yay > 2 ; . . . . . 
(iv) i sin” x dx. (An exercise to convince you that this substitution 
should be used only as a last resort.) 


. 1% . 
(v) / wee (A last resort.) 


Derive the formula for [ sec.x dx in the following two ways: 
(a) By writing 


] cos x 


GOSX Gos" x 
cos x 


= 
} — sin“ x 


l cosx COs x 
= — | ————_ + ——— ] 
2) AE sim ] —sinx 


an expression obviously inspired by partial fraction decompositions. Be 
sure to note that f cos x/(1 —sinx) dx = —log(1 —sin x); the minus sign 


is very important. And remember that 5log@ = log /a. From there 


tro]l— 


on, keep doing algebra, and trust to luck. 

(b) By using the substitution f = tanx/2. One again, quite a bit of manip- 
ulation is required to put the answer in the desired form; the expression 
tanx/2 can be attacked by using Problem 15-9, or both answers can 
be expressed in terms of ¢. There is another expression for f sec x dx, 
which is less cumbersome than log(sec x + tan x); using Problem 15-9, 
we obtain 


x 
1 + tan — 
F 2 G a ) 
cer lyr = oO ooo — oe c — or . 
sec X ax og p og (tan 5 ate =) 
1 — tan 5 


This last expression was actually the one first discovered, and was due, 
not to any mathematician’s cleverness, but to a curious historical acci- 
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14. 


LS. 


16. 


7. 


18. 


19: 
20. 


Zi 


Ze. 


e235: 


dent: In 1599 Wright computed nautical tables that amounted to definite 
integrals of sec. When the first tables for the logarithms of tangents were 
produced, the correspondence between the two tables was immediately 
noticed (but remained unexplained until the invention of calculus). 


The derivation of / e* sinx dx given in the text scems to prove that the only 
prinntivesols f(x) =iessin x is F(x) = e* (sin x — cosx)/2, wherease# (x) = 
e*(sinx — cosx)/2+C is also a primitive for any number C. Where does C 
come from? (What is the meaning of the equation 


/ @ sm vdx =i sinx —e Gosx — / e* sin x dx?) 
Suppose that f” is continuous and that 


ie (GFE G)\smxdxy = 2 
0 


Given that f(z) = 1, compute f (0). 


(a) Find f aresin x dx, using the same trick that worked for log and arctan. 


*(b) Generalize this trick: Find f{ f~'(x) dx in terms of { f(x) dx. Compare 


with Problems 12-21 and 14-14. 


(a) Find f sin” x dx in two different ways: first using the reduction formula, 
: ~ n ye Y 
and then using the formula for sin* x. 
(b) Combine your answers to obtain an impressive trigonometric identity. 
Express f log(log x) dx in terms of {(logx)~! dx. (Neither is expressible in 
terms of elementary functions.) 


> 
Xe 


4 ao) 9 ~ 
Express jaxces dx im terms of t/sen*udan 


Prove that the function f(x) = e*/(e>* +e* +1) has an elementary prunitive. 


(Do not try to find it!) 


Prove the reduction formulas in the text. For the third one write 


[= dx a / ae x* dx 
(x2 + 1)" = (x2 + ]jr-! (x2 + 1)" 


and work on the last integral. (Another possibility is to use the substitution 
X == KET bbe 


Find a reduction formula for 


(a) if xe" ax 
(b) Joogs” dx. 


Prove that 


cosh x 


gl cosh. x sinh x _ 


pi 


No] = 


(See Problem ae for the significance of this computation.) 
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24. Prove that 
2 ? 


CO fla+b—x)dx. 


a a 


(A geometric interpretation makes this clear, but it is also a good exercise in 
the handling of limits of integration during a substitution.) 


25. Prove that the area ofa circle of radius r is tr. (Naturally you must remem- 
ber that z is defined as the area of the unit circle.) 


26. Let @ be a nonnegative integrable function such that @(x) = 0 for |x| > 1 


] 
and such that fl =i tors = Ovlet 
=i 


] 
pn(x) = re 


h 
(a) Show that @;(x) = 0 for |x| > h and that Oo, —a, 
—h 
(b) Let f be integrable on [—1, 1] and continuous at 0. Show that 


1 h 
fon i Feo goon 
hoO0F J_] h0t J_p 


(c) Show that 


, | h 
lim Se Oe ae 
h-0+* f_] he +x 
The final part of this problem might appear, at first sight, to be an exact 
analogue of part (b), but it actually requires more careful argument. 


(d) Let f be integrable on [—1, 1] and continuous at 0. Show that 


] 
lim / ee = 77 (0): 


h—0+ ] h2 + x? 


Hint: If / is small, then h/(h? + x2) will be small on most of [—1, 1]. 
‘The next two problems use the formula 


ey as 5 
a f(@)" dé, 
- 9 

derived in Problem 13-24, for the area of a region bounded by the graph of f in 
polar coordinates. 


27. For each of the followmg functions, find the area bounded by the graphs in 
polar coordinates. (Be careful about the proper range for 6, or you will get 
nonsensical results!) 

(1) TO) —asing: 

(ii) f(0) =2+cosé. 

(ii) (0)? = 2a? cos 20. 

(iv) f(0) =acos 20. 
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FIGURE | 


28. 


Figure | shows the graph of f in polar coordinates; the region OAB thus 
Oy 


l 9 
has area a f(@)° dé. Now suppose that this graph also happens to be 

“ J6 
the ordinary graph of some function g. ‘Then the region OAB also has area 

xo 
arca AOx,B +f g— area AOXoA. 
X| 

Prove analytically that these two numbers are mdeed the same. Hint: The 
function g is determined by the equations 


ie waa cos 6, ga) = (ac) sire. 


The next four problems use the formulas, derived in Problems 3 and 4 of the 
Appendix to Chapter 13, for the length of'a curve represented parametrically (and, 


in particular, as the graph of a function in polar coordinates). 


jay 


30. 


OM 


Let c be a curve represented parametrically by u and uv on [a,b], and let h 
be an increasing function with h(@) = a and h(b) = b. Then on [a,b] the 
functions 4 = uoh, v = vol give a parametric representation of another 
curve C; mtuitively, ¢ is Just the same curve c traversed at a different rate. 


(a) Show, directly from the definition of length, that the length of ¢ on la, b| 
equals the length of é on [a,b]. 

(b) Assuming differentiability of any functions required, show that the 
lengths are equal by using the integral formula for length, and the ap- 
propriate substitution. 


Find the length of the following curves, all described as the graphs of func- 
tions, except for (ii), which is represented parametrically. 


os , 
i) f(x)= ze ae! Oars We 


] 
4 : 2) 2 
(i) fQ)=ax" +75. Ig ese 
O00 ee a> cos’ ft, — a> sin’ t, O =f = B77, 
Gi) f(a) = log(cos x); 0=x% = 27 or 
(vy) Bix) =loae ere 
(vi) ."f (vw) = ares GS 25 


For the following functions, find the length of the graph in polar coordinates. 


(1) £(@) =@ Gos. 

(i) f((@) =a(Ul —cos8). 

(ii) (0) =asin?(6/2). 

(iv Rie) =2 Oi Oss 27. 
(yy = 3 ste? 0m a 3: 


oo. 


33. 


of. 


35. 
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In Problem 8 of the Appendix to Chapter 12 we described the cycloid, which 
has the parametric representation 


6) — 2 = ae y = u(r) S"a(l— cost) 


(a) Find the length of one arch of the cycloid. [Answer: 84a.| 
(b) Recall that the cycloid is the graph of vo u7!, Find the area under 
one arch of the cycloid by using the appropriate substitution in f f and 


. . 9) 
evaluating the resultant integral. [Answer: 3za°.| 


Use induction and integration by parts to generalize Problem 14-10: 


i. = Nn Xx Uy, | 
[ewe uy ag) fundr) dur) ..-) din 
0 he: 0) 0 0 


If f' is continuous on [a,b], use mitegration by parts to prove the Riemann- 
Lebesgue Lemma for f: 


b 
lim f(t) sin(Ar) dt = 0. 
A> 00 
a 
This result is just a special case of Problem 15-26, but it can be used to prove 
the general case (in much the same way that the Riemann-Lebesgue Lemma 
was derived in Problem [5-26 from the special case in which f is a step 
function). 


The Mean Value Theorem for Integrals was introduced in Problem 13-23. 
The “Second Mean Value ‘Theorem for Integrals” states the following, Sup- 
pose that f is integrable on [a,b] and that ¢ is either nondecreasing or 
nonincreasing on [a,b]. Then there is a number & in [a, b] such that 


b b 


E 
Tea Om) dx = wa) | f(x)dx + $(b) f(x)dx. 
a g 


a 


In this problem, we will assume that f is continuous and that ¢ is differen- 
tiable, with a continuous derivative @’. 


(a) Prove that if the result is true for nonincreasing @, then it is also true for 
nondecreasing @. 

(b) Prove that if the result is true for nonincreasing @ satisfying @(b) = 0, 
then it is true for all nonincreasing ¢. 


Thus, we can assume that ¢ is nonincreasing and @(b) = 0. In this case, 
we have to prove that 
b 


Vio as — 1a) | i (x) dx. 


a 
(c) Prove this by using tegration by parts 
J “ D, oO 5 Ss c 5 | c De 
(d) Show that the hypothesis that ¢ is either nondecreasing or nonmecreasing 
is needed. 
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From this special case of the Second Mean Value ‘Theorem for Integrals, the 


general case could be derived by some approximation arguments, Just as in the case 


of the Riemann-Lebesgue Lemma. But there is a more instructive way, outlined 


in the next problem. 


36. 


(a) Given q@j,...,@, and by,..., by, let s, = a, +--+-+ ay. Show that 


(4) apd) +--+ + ayb, = 5) (b1 — b2) + 52(b2 — b3) 
ee Spey (b,,=1 a by) che SD); 


This disarmingly simple formula is sometimes called “Abel’s formula for summation 
si i é 
by parts.” It may be regarded as an analogue for sums of the mtegration by parts formula 
b : b ; 
f Wg) dx = fib)g(b) — fla)g(a) — fig (x) dx, 


a a 
especially if we use Riemann sums (Chapter 13, Appendix). In fact, for a partition 
P = {to,..., tn} of [a, b], the left side is approximately 


n 
(1) Yo Fate = te), 
=I 
while the right side is approximately 
i 
f(b)g(b) — fla)g(a) — D> Flt) g! (te = th—1) 
k=l 
which is approximately 
n 
E , ; B(th) — g(te—1) 
F(b)g(b) — f agta) — > f(y) — EEE 
P| Uli 


H 
= f(b)g(b) — flaygta) + y ftg)[8(K—1) — 80K] 
k=] 
nN 
= f(b)g(b) — flaygia) + Y [Ff (K) — F@I]- [8Ux—1) — 8K) 
k=] 


ie — hey 


n 
sry files) 2S B= 1) — ety). 
=| 
Since the right-most sum is just g(a) — g(b), this works out to be 


n 
(2) [ f(b) — fag’) + “Lf x) — fF] - [gu_) = gy); 


= 
If we choose 
ap = f (te) (te — th). by = g(te—}) 
then 
n 
( 1) 1s y ak by, 
k=] 
which is the left side of (*), while 
k k 

a Sy f(y — tj) is approximately ys CA) = A) SACO ae 

i=! i=] 


so 
n 
@ is approximately Snby + » sp (bp — dp_), 
k=] 


which is the right side of («). 


(b) 


37. (a) 


(b) 
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This discussion 1s not meant to suggest that Abel’s formula can actually be derived from 
the formula for integration by parts, or vice versa. But, as we shall see, Abel’s formula can 
often be used as a substitute for integration by parts in situations where the functions in 
question aren't differentiable. 


Suppose that {b,} is nonincreasing, with b, > 0 for each n, and that 
m<a;t+-::-+ta, <M 
for all n. Prove Abel’s Lemma: 
bym <ayby +--+ +anbn < b\M. 
(And, moreover, 
bym < apby + +++ + anb, < byM, 


a formula which only looks more general, but really isn’t.) 

Let f be integrable on [a, b] and let ¢ be nonincreasing on [a, b] with 
p(b) = 0. Let P = {t0,...,t,} be a partition of [a,b]. Show that the 
sum 


2 (CRMC VASES 
i=1 


lies between the smallest and the largest of the sums 


k 
$(@) >) f GANG — f-1). 


=i 
Conclude that 
2 


f(x )b (x) dx 


a 


lies between the minimum and the maximum of 


oa) f pee dt: 


and that it therefore equals oa) | f(t) dt for some & in [a, ]. 


Show that the following improper integrals both converge. 


| 
(1) / sin (: + -) dx. 
0 XxX 
| 
53 a: 
(11) / sin~ (: + =| dx. 
0 XxX 


Decide which of the following improper integrals converge. 
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| 
38. (a) Compute the (improper) integral [ lOGxdx: 
0 


18 
(b) Show that the improper integral / log(sin.x) dx converges. 
0 


(c) Use the substitution x = 2u to show that 


+ m/2 m/2 
/ log(sirx) ax — 2 f log(sin.x) dx + 2 | log(cos.x)dx +m log 2. 
0 0 0 


n/2 
(d) Compute [ log(cos.x) dx. 
0 
ue 
(e) Using the relation cos x = sin(1/2 — x), compute i log(sin.x) dx. 
0 


39. Prove the following version of integration by parts for improper integrals: 
oo O° 

— / u(x)v (x) dx. 
a a 


The first symbol on the right side means, of course, 


| u'(x)v(x)dx = u(x)v(x) 


a 


him u(x)vu(x) — u(a)v(a). 


*40. One of the most important functions in analysis is the gamma function, 


fp 6) 
Ge ge TS 
0 


(a) Prove that the improper integral (x) is defined if x > 0. 
(b) Use integration by parts (more precisely, the improper integral version 
in the previous problem) to prove that 


fal) =sVa): 


(c) Show that [(1) = 1, and conclude that (a) = (a — 1)! for all natural 
numbers i. 


he gamma function thus provides a simple example ofa continuous function 
which “interpolates” the values of n! for natural numbers 1. Of course there 
are infinitely many continuous functions f with f(7) = (a — 1)!; there are 
even infinitely many continuous functions f with f(x + 1) = xf (x) for all 
x > 0. However, the gamma function has the important additional property 
that log © T is convex, a condition which expresses the extreme smoothness 
of this function. A beautiful theorem due to Harold Bohr and Johannes 
Mollerup states that P is the only function f with logo f convex, f(1) = | 
and f(~ + 1) =xf(x). See reference [43] of the Suggested Reading. 


*41. (a) Use the reduction formula for f sin" x dx to show that 


() 


rig} 
sae. n nh | ae n-2 
She Sil =X ae. 
JO) HH JO 
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(b) Now show that 


(c) 


favs eee 22 4 6 2n 
ee aed nas DEE T, De 
["s sf) Se ge A Dg 2n —1 
Pee ae ee ane On 
and conclude that 
x /2 ‘ 
ED Dea a O50 2n 2n [ ae ee 
Dil Me Br Se Si - 7. 2n—1 2n+1 2/2 - 41 
if Sie) # Xs 
0 


Show that the quotient of the two integrals in this expression is between 
1 and | + 1/2n, starting with the equalities 


2n+1 ] 


. qe) nf) j= 
0 < sin Mom Ls ow tor Oke 50/2. 


This result, which shows that the products 


2 2 & 4°56 6 2n 2n 


eons 557 Dre Dpee 


can be made as close to 2/2 as desired, is usually written as an infinite 
product, known as Wallis’ product: 


nu 2 WP Ay A 6) 16 


Di he Shatin SuSE aT 


Show also that the products 


I) Za ee 2n 
Jn Meso... nr — 1) 


can be made as close to /7 as desired. (This fact is used in the next 
problem and in Problem 27-19.) 


Wallis’ procedure was quite different! He worked with the integral RG Sek: 
(which appears in Problem 42), hoping to recover, from the values obtained for natural 


numbers n, a formula for 
TU Ds iW 
—= = x=) ade 
4 0 


A complete account can be found in reference [49] of the Suggested Reading, but the 
following summary gives the basic idea. Wallis first obtained the formula 
I Di Al 5} 
2\n = Id: 
(ll Sere) dx = oar 
[ 5) 2n + | 
@ ate 2me eal) 


USAR DnOn eh,” Dateien)! 


He then reasoned that 2/4 should be 


| aay 21 (5! 
ii Gag Pa! = (1)?2. 
0 an) mr 


| 


i) 
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If we interpret +! to mean P(1 + 4), this agrees with Problem 45, but Wallis did not 
know of the gamma function (which was invented by Euler, guided principally by Wallis’ 


6 O} : : -— 2) 4 
work). Since (2n)!/(a!)- is the binomial coefficient ( ‘h Wallis hoped to find 5! by 
n 
2 
finding (' a fon p= ¢ = |/2Now 
P 


(ae Sp) pad — > ae 


p q! 
and this makes sense even if p is not a natural number. Wallis therefore decided that 
3+4 (44+q)--Q) 
( s 7 q! . 
I 


E ae ; Bust Cn ere 
With this interpretation of ( ‘) for p = 1/2, it is still true that 
P 


a) pg tl Co 
Pp = q+] Pp ; 


tol 
+ 


: q : : 2 
Denoting ( ) by W(q) this equation can be written 


tl 


aii ig ull 2q+3 


W(q+1)== W(qg) = 
q qt] Z 


which leads to the table 
q ! 2 3 


w@q) 3% 3-3 


ln 
bolt 
os 
On 


bolw 


q ; 
gy Sa me Se 


Next Wallis notes that if a,, a2, a3, ag are 4 successive values W(qg), W(q + 1), W(q +2), 
W(q + 3), appearing in either of these tables, then 
2g+3 2¢+5 2q+7 


az _ 43 ag 2 
2g+4 2¢+6 


= >— since ————~ 
aq a@ @ 2qg+2 


(this says that logo(1/W) is convex, compare the remarks before Problem 41), which 


5S 
unphes that 
az a3 a4 
= 2 /—5, 
ay a an 


Wallis then argues that this should still be true when a), a2, a3, a4 are four successive 

values in a combined table where q is given both mteger and half-integer values! Thus, 
: a 5 2 ; : 

taking as the four successive values W (na + ly W(n), W(n+ 5), Win + 1), he obtains 


4 4 6 
ere 
3S 
spn 


which yields simply 


Day a al 4 D pthakiba (6000 (DVN as Daas 8} 
ey ee ee ee ee |e ee 
Vn+3 7 3) 8B) e) o Sonn (2p 45 Im se II) Dy Je D 


from which Wallis’ product follows immediately. 


ee Gas 


ods 
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[@ @) 
It is an astonishing fact that improper integrals i f(x) dx can often be 
0 
b 
computed in cases where ordinary integrals f(x) dx cannot. There is no 
a 


b os) 
7 | 
elementary formula for ‘ e * dx, but we can find the value of / em dx 
a 0 
precisely! There are many ways of evaluating this integral, but most require 
some advanced techniques; the following method involves a fair amount of 
work, but no facts that you do not already know. 


(a) Show that 


[iu mame eo a o08 6 ay 
0 5 5 2n + 1 

ce I 1 6) 2n —3 
[ ep Oy Pe 9, 0 


(This can be done using reduction formulas, or by appropriate substitu- 
tions, combined with the previous problem.) 


(b) Prove, using the derivative, that 


te en" for 0 = “=< I: 
3 l 
e* <— for0O<x. 
I+ x- 


(c) Integrate the nth powers of these inequalities from 0 to | and from 0 to 
oo, respectively. Then use the substitution y = /n x to show that 


pag 2n 
Noose... ro 
f  ® || 
00 i 
<|/ (Ee dy =f Cr ay, 
0 0 
XN 8 2n —3 
<< Woe me eee ——-,, 
ee 2 4 2h) 


(d) Now use Problem 41(d) to show that 


[ = a 
Ca 1) wk 


0 


(a) Use mtegration by parts to show that 


> sin x cosa cosh > cosx 
io= — — — GOS 
os a b a ee 


POO . . ‘TT ~ . . . 
and conclude that fy (sin.x)/x dx exists. (Use the left side to investigate 
the limit as a > O* and the right side for the limit as b > ov.) 
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44, 


*49) 


*46. 


(b) Use Problem 15-33 to show that 


x sm(n + Oy, 
——_—+—_dt=7 
0 y 


sin — 


2 
for any natural number n. 
(c) Prove that 
id | 2 l 

lim sin(A + 5)t | — — —— | dt =0. 

A>oo Jo a t aE 

sin = 

2 


Hint: ‘The term in brackets is bounded by Problem 15-2(vi); the 
Riemann-Lebesgue Lemma then applies. 
(d) Use the substitution wv = (A + 5)t and part (b) to show that 


COC SING ; 1h 
dx = —. 
0 xX 2 


io, 2) 
Given the value of : (sin x)/x dx from Problem 43, compute 
0 


O° = 9 
esi \e 
dx 
0 x 


by using integration by parts. (As in Problem 38, the formula for sin 2x will 


play an important role.) 


(a) Use the substitution u = t* to show that 


l e8 ex 
Le) =— Ce Git 
xX JO 


(b) Find (4). 


jee 
is integrable on every interval [a,b] for 0 < a < b, 


(a) Suppose that ue 


and that lim f(x) = A and lm f(x) = B. Prove that for all a, B > 0 


o> 


we have 


(gs AL Dr i 5 
0} 


x 


dx use two different substitutions. 


Ngee oe . 
Eiimnt? ste estimate [ aCe ee 


x 
(e.2) f ; 
(b) Now suppose instead that | dx converges for all a > 0 and that 
A x 
lim f(x) =A. Prove that 
r>0 
es ; 
(ax) — f (Px) 
i es) dx = Alog eo 
0 x a 
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(c) Compute the following integrals: 


of 


Gi) / cos(@x) — cos(Ppx) Ba. 
0 


In Chapter 13 we said, rather blithely, that integrals may be computed to any 
degree of accuracy desired by calculating lower and upper sums. But an applied 
mathematician, who really has to do the calculation, rather than just talking about 
doing it, may not be overjoyed at the prospect of computing lower sums to evaluate 
an integral to three decimal places, say (a degree of accuracy that might easily be 
needed in certain circumstances). ‘The next three problems show how more refined 
methods can make the calculations much more efficient. 


We ought to mention at the outset that computing upper and lower sums might 
not even be practical, since it might not be possible to compute the quantities m; 


and M; for each interval [4)-1, 4]. It is far more reasonable simply to pick points .; 
Hn 


in [f;-1,¢;] and consider » fi)» G — 1). This represents the sum of the areas 
i= 

of certain rectangles which partially overlap the graph of f—see Figure | in the 

Appendix to Chapter 13. But we will get a much better result if we instead choose 

the trapezoids shown in Figure 2. 


FIGURE 2 


Suppose, in particular, that we divide [a,b] into n equal intervals, by means of 


the points 
_[b-a : 
=a! =artih. 


n 


Then the trapezoid with base [4,-1.4] has area 


Kj + fi) 


5 i) 
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and the sum of all these areas is simply 


By =| OE LO ALO yg OT) 


h = pia 
=5 aig Sar +gO) ; a 


This method of approximating an integral is called the ¢rapezoid rule. Notice that to 
obtain Xo, from &,, it isn’t necessary to recompute the old f(¢;); their contribution 
to Xo, 1s just 5 Zn. Dam practice it is, best to compute 27, H4, Ug: ... to get 
b b 
approximations to i f. In the next problem we will estimate (5, 
a a 
47. (a) Suppose that f” is continuous. Let P; be the linear function which agrees 
with f at 4-1 and ¢;. Using Problem 11-46, show that if 2; and N; are 
the minimum and maximum of f” on [f;_1, 4;] and 


1, 
o— i (x — ty-1))(x — t;) dx 
h-] 


— 


==} eagle 
mo 


t 


then 


(b) Evaluate / to get 


n,h> f N;h? 
= Ea fie a ee 
t,-] 


1 


(c) Conclude that there is some c m (a, b) with 


HN (b—a) 


— i 
IS a “£0 


; : z Ae - 4 ; 
Notice that the “error term” (b — a)? f"(c)/12n? varies as 1/1? (while 
the error obtained using ordinary sums varies as 1/1). 


We can obtain still more accurate results if we approximate f by quadratic 
functions rather than by linear functions. We first consider what happens when 
FIGURE 3 the mterval [a, b] is divided into two equal intervals (Figure 3). 


48. (a) Suppose first that a = 0 and b = 2. Let P be the polynomial function 
of degree < 2 which agrees with f at 0, 1, and 2 (Problem 3-6). Show 
that 


5 


2 | 
[b= 51F +470) + £2) 
0 = 


(b) Conclude that m the general case 


= h 
| a "| ray +4 (4 “) + £05). 
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b b 

(c) Naturally a f when f is a quadratic polynomial. But, re- 
a a 

markably enough, this same relation holds when / is a cubic polynomial! 

Prove this, using Problem 11-46; note that f 


it 


is a constant. 


The previous problem shows that we do not have to do any new calculations 


b 
to compute i! Q when Q 1s a cubic polynomial which agrees with f at a, b, and 
a 


a+b . 
: we still have 


a 


b es | 
Q= —— Lr +4f (¢ 3 ’) a r00)| : 


But there is much more lee-way in choosing Q, which we can use to our advantage: 


49. (a) Show that there is a cubic polynomial function Q satisfying 


O(a) = fla), Q(b) = fib). o(*) Ff (4°) 


2 


- 


o(S j=r (SS). 


Elint; Clearly OC.) = P(x) = At — 9g) Ga) (« — 


at+b 


) for some A. 
b) Prove that if f“ is defined on [a,b], then for every x in [a,b] we have 
; y 


} 2 (4) 
fi) — OH) =(«—-a) (: a as ’) (x — a 


for some € in (a,b). Hint: Imitate the proof of Problem 11-46. 
(c) Conclude that if f is continuous, then 


: b—a a+b ; (b.—a)y (4) 
: i mere [rw aa f (*) aa | = 80 1 (c) 


for some c in (a,b). 


(d) Now divide [a,b] into 27 mtervals by means of the points 


: b—-a 
te =artih, — : 
2n 


- 


Prove Sumpson’s rule: 
n—| 


a on, — "2, ne 
[Ge = (or 44d Fea +2Y osm) + 10] 


(b=ay 
2880n4 


f° @ 


for some ¢ m (a, bd). 
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FIGURE 2 


FIGURE 3 


APPENDIX. THE COSMOPOLITAN INTEGRAL 


We originally introduced integrals in order to find the area under the graph of 
a function, but the integral is considerably more versatile than that. For example, 
Problem 13-24 used the integral to express the area of a region of quite another 
sort. Moreover, Problem 13-25 showed that the integral can also be used to ex- 
press the lengths of curves—though, as we've seen in Appendix to Chapter 13, a 
lot of work may be necessary to consider the general case! ‘This result was prob- 
ably a little more surprising, since the integral seems, at first blush, to be a very 
two-dimensional creature. Actually, the integral makes its appearance in quite a 
few geometric formulas, which we will present in this Appendix. ‘To derive these 
formulas we will assume some results from elementary geometry (and allow a little 
fudging). 

Instead of going down to one-dimensional objects, we'll begin by tackling some 
three-dimensional ones. ‘here are some very special solids whose volumes can 
be expressed by integrals. ‘Vhe simplest such solid V is a “solid of revolution,” 
obtained by revolving the region under the graph of f > O on [a,b] around 
the horizontal axis, when we regard the plane as situated in space (Figure 1). 
If P = {&,..-,t:} is any partition of [a,b], and m; and M; have their usual 
meanings, then 


5 
min; (t; — t;—1) 


is the volume of a disc that lies inside the solid V (Figure 2). Similarly, 
a M;7(t; — t;-)) is the volume of a disc that contains the part of V between f-| 
and ¢;. Consequently, 


i it 
5) 9) 
IN Yo mint —t;-}) < volume V <z So MP (i —4;_}). 


i=] fl 


But the sums on the ends of this inequality are just the lower and upper sums for 


f? on [a,b]: 
n-L(f?, P) < volume V <2-U(f?, P). 


Consequently, the volume of V must be given by 


b 
7 3} 
volune V=az FQ) ax. 
a 


This method of finding volunies is affectionately referred to as the “disc method.” 

Figure 3 shows a more complicated solid V obtained by revolving the region 
under the graph of f around the vertical axis (V is the solid left over when we start 
with the big cylinder of radius 6 and take away both the small cylinder of radius a 
and the solid V; sitting right on top of it). In this case we assume a > 0 as well 


19, Appendix. The Cosmopolitan Integral 403 


as f > 0. Figures 4 and 5 indicate some other possible shapes for V. 


FIGURE 4 


FIGURE 5 


bor a partition P = {t, .... tn} we consider the “shells” obtained by rotating the 
rectangle with base [f;-1, t;] and height m,; or M; (Figure 6). Adding the volumes 
of these shells we obtain 
u n 
N Ser - aie) < volume V <2z Sy M(t," = ion 


i=! i=] 


which we can write as 


n n 
a So milti TE); — Gee volume V gaan yo M Ge tt Be). 


i=l i= 


— 


FIGURE 6 Now these sums are not lower or upper sums of anything. But Problem 1 of the 
Appendix to Chapter 13 shows that each sum 


H i 


So miti(t; aE sl) and yo mitt — 1) 


b 

can be made as close as desired to / xf(x)dx by choosing the lengths t; — 4; 
a 

small enough. ‘The same is true of the sums on the right, so we find that 


b 
volume V = an f NCoGa x. 
a 
this is the so-called “shell method” of finding volumes. 

The surface area of certam curved regions can also be expressed in terms of inte- 
erals. Before we tackle complicated regions, a httle review of elementary geometric 
formulas may be appreciated here. 

Figure 7 shows a right pyramid made up of triangles with bases of length / and 
altitude s. ‘Vhe total surface area of the sides of the pyramid is thus 

] 


FIGURE 7 Sa 
5! 


where p is the perimeter of the base. By choosing the base to be a regular polygon 
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FIGURE 8 


FIGURE 9 


(b) 


biG Oi Rals 


10 


with a large number of sides we sec that the area ofa right circular cone (Figure 8) 
must be 

SQrr\s =7rs 

5 (27r) 
where s is the “slant height.” Finally, consider the frustum of a cone with slant 
height s and radu rj and rz shown in Figure 9(a). Completing this to a cone, as 
in Figure 9(b), we have 


Sy Sot 

ry ry 
so 

ris ros 
s; = ——., sp +s = ——. 
mr r-1) 
Consequently, the surface area is 
| A Vi Sopa AW 
Wro(s}| +8) —azr\s, = 1S———— = 27s(r| +1). 
2-1 


Now consider the surface formed by revolving the graph of f around the hori- 
zontal axis. For a partition P = {tg,...,t,} we can inscribe a series of frustums of 
cones, as in Figure 10. ‘The total surface area of these frustums 1s 


ay fi + fib) i = tv? + Lf) — SGP 


il 


aaek > [FG rd ial == ) Ga pain 


il 


By the Mean Value Theorem, this is 


mY [fli + fU)|V 1+ fi)? (i — 4-1) 
i=l 
for some x; in (4;-1, 4). Appealing to Problem 1 of the Appendix to Chapter 13, 


we conclude that the surface area Is 


b 
an f f@)v1i+ fier cm. 


PROBLEMS 


1. (a) Find the volume of the solid obtained by revolving the region bounded 
~ =] . . 
by the graphs of f(x) =x and f(x) = x* around the horizontal axis. 
) gra] : 
(b) Find the volume of the solid obtained by revolving this same region 


around the vertical axis. 


2. Find the volunie of a sphere of radius r. 
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3. When the ellipse consisting of all points (x, y) with x2 /a® = y*/b? = 11s 
rotated around the horizontal axis we obtain an “ellipsoid of revolution” 
(Figure 11). Find the volume of the enclosed solid. 


FIGURE 11 


4. Find the volume of the “torus” (Figure 12), obtained by rotating the circle 
(x — a)* + y? = b? (a > b) around the vertical axis. 


length b 


FIGURE 12 


5. <A cylindrical hole of radius a is bored through the center of a sphere of 
radius 2a (Figure 13). Find the volume of the remaining solid. 


RIGURE 13 
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6. (a) For the solid shown in Figure 14, find the volume by the shell method. 


FIGURE 14 


(b) This volume can also be evaluated by the disc method. Write down 
the mtegral which must be evaluated in this case; notice that it is more 
complicated. The next problem takes up a question which this might 


suggest. 


7. Figure 15 shows a cylinder of height b and radius f(b), divided into three 
solids, one of which, Vj, 1s a cylinder of height a and radius f(a). If f 
is one-one, then a comparison of the disk method and the shell method of 
computing volumes leads us to believe that 


b 
mbf (b)* -- maf (a) = 3 eae dx = volume V2 


a f(b) 
2n i yf '(y) dy. 


f(a) 


Prove this analytically, using the formula for fl f | from Problem 19-16, or 


more simply by going through the steps by which this formula was derived. 


FIGURE 15 


FIGURE 16 


10. 


11. 
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(a) Figure 16 shows a solid with a circular base of radius a. Each plane 
perpendicular to the diameter AB intersects the sold in a square. Using 
arguinents similar to those already used in this Appendix, express the 
volume of the solid as an integral, and evaluate it. 

(b) Same problem if each plane intersects the solid in an equilateral triangle. 


Find the volume of a pyramid (Figure 17) m terms of its height 4 and the 
area A of its base. 


FIGURE 17 

Find the volume of the solid which is the intersection of the two cylinders 
in Figure 18. Hint: Find the intersection of this solid with each horizontal 
plane. 


PGR Ws 


. . . . . 21 

(a) Prove that the surface area of a sphere of radius r is 4rr-. 
(b) Prove, more generally, that the area of the portion of the sphere shown 
in Figure 19 is 27rh. (Notice that this depends only on h, not on the 


position of the planes.) 


UEC DSS VE, IRS) 
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12. 


13. 


(c) A circular mud puddle can just be covered by a parallel collection of 
boards of length at least the radius of the circle, as in Figure 20 (a). Prove 
that it cannot be covered by the same boards if they are arranged in any 
non-parallel configuration, as in (b). 


= 


(a) (b) 


FIGURE 20 


(a) Find the surface area of the elhpsoid of revolution in Problem 19-3. 
(b) Find the surface area of the torus in Problem 19-4. 


The graph of f(x) = 1/x, x = 1 1s revolved around the horizontal axis 


Fiourc a); 


( 

(a) Find the volume of the enclosed “infinite trumpet.” 

(b) Show that the surface area 1s infinite. 

(c) Suppose that we fill up the trumpet with the finite amount of paint found 
in part (a). It would seem that we have thereby coated the infinite inside 
surface area with only a finite amount of paint. How is this possible? 


FIGURE 21 


PART fi 


INFINITE 
SEQUENCES 
AND 
INFINITE 
SERIES 


One of the most remarkable series of 
algebraic analysis is the following: 


pit gee eee 


1 P-2 
m(m — 1)(m — 2) 
hes 
m(m — 1)--- [m—(n— ])] 


A i eke G 


+ x" 


When m ts a positive whole number 

the sum of the series, 

which ts then finite, can be expressed, 

as is known, by (1 + x)". 

When m is not an integer, 

the series goes on to infinity, and it will 
converge or diverge according 

as the quantities 

mand x have this or that value. 

In this case, one writes the same equality 


(Itxn=1+—x 


m(m — 1) 
1-2 
.. . It ts assumed that 
the numerical equality will always occur 
whenever the sertes 1s convergent, but 
this has never yet been proved. 


x2+--- ele. 
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CHAPTER 


APPROXIMATION BY 
POLYNOMIAL FUNCTIONS 


‘There is one sense in which the “elementary functions” are not elementary at all. 
If p is a polynomial function, 


P(X) = ag + ayx +--+ + ayx", 


then p(x) can be computed easily for any number x. This is not at all true for 
functions like sin, log, or exp. At present, to find Ios, ‘i 1/t dt approximately, 
we must compute some upper or lower sums, and make certain that the error 
involved in accepting such a sum for log x is not too great. Computing e* = 
log™'() would be even more difficult: we would have to compute log a for many 
values of a until we found a number a such that log a is approximately x—then a 
would be approximately e’. 

In this chapter we will obtain important theoretical results which reduce the 
computation of f(x), for many functions f, to the evaluation of polynomial func- 
tions. ‘The method depends on finding polynomial functions which are close ap- 
proximations to f. In order to guess a polynomial which is appropriate, it is useful 
to first examine polynomial functions themselves more thoroughly. 

Suppose that 

P(X) = ag + ayx +--+ + a,x". 


It is interesting, and for our purposes very important, to note that the coefficients a; 
can be expressed in terms of the value of p and its various derivatives at 0. To 
begin with, note that 


OR ae 
Differentiating the original expression for p(x) yields 
Poa teanx + na 


‘Therefore, 
pi Oe pny = aj. 


Differentiating again we obtain 
9) 
p’ (x) = 2a2+3-2-a3x +---+n(n—1)-a,x"~2. 
Therefore, 
" (2) 
PAO) p= OO) Pa, 
In general, we will have 
p® (0) 
— 
If we agree to define 0! = 1, and recall the notation p© = p, then this formula 
holds for k = 0 also. 


p (0) =kla, or a= 


4] 
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Ifwe had begun with a function p that was written as a “polynomial in (x —a),” 
p(x) =ag t+ay(x — a) +++ +an(x — a)", 
then a smular argument would show that 


p'(a) 
ie a 


ay = 


Suppose now that f is a function (not necessarily a polynomial) such that 


f (Ge oe 


all exist. Let 


and define 


Prhia(X) = ag tay(x —a) +--+ tay(x — a)". 


The polynomial P,.¢ is called the Taylor polynomial of degree n for f at a. 
(Strictly speaking, we should use an even more complicated expression, like Pyar, 
to indicate the dependence on f; at times this more precise notation will be useful.) 
The ‘Taylor polynonnal has been defined so that 


P, g(a) = f(a) forO<k <n; 


in fact, it is clearly the only polynomial of degree <n with this property. 

Although the coefficients of Py.a,¢ seem to depend upon f in a fairly comph- 
cated way, the most important elementary functions have extremely simple ‘Taylor 
polynomials. Consider first the function sin. We have 


smi Oje— 0. 
sin’ (0) = cosO0 = 1, 
sin’ (0) = —sin0 = 0, 
sin” (0) = —cos0 = —1, 
sin) (0) = sin0 = 0. 


From this point on, the derivatives repeat in a cycle of 4. ‘he numbers 


sin” (0) 
i. 
are 
| | | | 
Oo, t. 0; — aI 0, aI" 0, — 7 0. or 
Therefore the ‘Faylor polynomial P2,,,1,9 of degree 22 + 1 for sin at 0 ts 
P. a ep 
TS TS a Cry! 


(OT courst, 1),4. 110) = 2 on? 0) 
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The ‘Taylor polynomial P2,9 of degree 2n for cos at 0 is (the computations are 


left to you) 
we x2 x4 xo a yen 
P2n.9(X) = = at = Arar a + (al ) Qn) 


The ‘Taylor polynomial for exp is especially easy to compute. Since exp“ (0) = 
exp(O) = 1 for all k, the Taylor polynomial of degree n at 0 is 
i x? 74 x? 


qa teeat oa. 


The ‘Taylor polynomial for log must be computed at some point a # 0, since 
log 1s not even defined at 0. The standard choice is a = 1. Then 


P,o(4) = 1+ 


I 

log’ (x) = —, los (i) ="). 
x 

f} 1 iff 
log (log (1) le 
ee 
| z log’”’(1 2 
og” "O) = =, og (1) = 2; 


m general 


(-1)k& 1k - Dt 


xk 


Lo Ny Sea 


lee (x)= 


Therefore the ‘Taylor polynomial of degree n for log at | 1s 


(x-1)? («- 1 (—1)"!(x = 1)" 
Fra O6) = Nah 1) ce 


It 1s often more convenient to consider the function f(x) = log(| +x). In this 
case we can choose a = 0. We have 
F(x) Slow lar x) 
sO 
FO) =log™() = (- DENK - DD. 
Therefore the Taylor polynomnal of degree n for f at 0 is 
ee x2 e x? xt " 2 (—])t—hyn 
OLY =) — = —_> — see — 
ie Z 3 + n 
There ts one other elementary function whose ‘Taylor polynomial ts mportant 


arctan. ‘he computations of the derivatives begin 


| 
arctan (x) = ea arctan (0) = I, 
—2x* 
arctan” (x) = ——x—, arctan” (0) = 0: 
Arctam (x) Cl ae arctan’ (Q) 


i 
tan 


QUE ie ee et 
d+x2)4 


arctan” (x) = arctan’”’(0) = —2. 
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It is clear that this brute force computation will never do. However, the ‘Taylor 
polynomials of arctan will be easy to find after we have examined the properties 
of ‘Taylor polynomials more closely—although the Taylor polynomial Py.¢,¢ was 
simply defined so as to have the same first 1 derivatives at a as f, the connection 
between f and Py.a,¢ will actually turn out to be much deeper. 

One line of evidence for a closer connection between f and the ‘Taylor polyno- 
mials for f may be uncovered by examining the ‘Taylor polynomial of degree 1, 
which is 


Pia(x) = fla) + f(@& — a). 


Notice that 
i (x) * i akx) -_ uf (x) al f (a) 


xX =a “= a 


— f(a). 


Now, by the definition of f’(a) we have 


: a(x) 7 Piece) 
i ——— 
xa x—-—a 


Q; 


4 


) te 
Pyo9(x) =14+x4+ > 


Pro(x) =1+x 


PO TICGS LUIS Deh 


In other words, as x approaches a the difference f(x) — Pj,q(x) not only becomes 
small, but actually becomes small even compared to x — a. Figure 1 illustrates the 
graph of f(x) =e* and of 


P; of) = f (0) + f'(O)x =14 x, 


which is the ‘Taylor polynomial of degree | for f at 0. ‘The diagram also shows 
the graph of 


" 0) . x 
J Lee b+aut+ : 


onc AW) geal YS me 


which is the ‘Taylor polynomial of degree 2 for f at 0. As x approaches 0, the 
difference f(x) — P2.9(x) seems to be getting small even faster than the difference 


THEOREM 1 
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f(x) — Pi o(x). As it stands, this assertion is not very precise, but we are now 
d 1,0 yor ’ 
prepared to give it a definite meaning. We have just noted that in general 


lin 0. 
xa xXx-—a 
For f(x) = e* and a = 0 this means that 
x)—P *_— J] — 
lim F(x) — Pio) aie eee Si 
x0 x x0 35 


On the other hand, an easy double application of H6pital’s Rule shows that 


Thus, although f(x) — P;,9(+) becomes small compared to x, as x approaches 0, it 
does not become small compared to x*. For P2.9(x) the situation is quite different; 
the extra term x*/2 provides just the right compensation: 


26 if x 
CL ae Tay  e—til—-x 
lim = bien 
x0 x + x0 DX 
a ae | 
= lim =((); 
x0 


This result holds in general—if f’(a) and f”(qa) exist, then 


x) — Prat 
lim J) = Pa) Zeid =i (Ip 


xa (x —a) 


in fact, the analogous assertion for P,q 1s also true. 


Suppose that f is a function for which 
Gah f @@) 


all exist. Let 


and define 
Pra@) = do + ans = @) Pe ay (X% = ay. 


Then 
. f(x) - Page) 
ee 


xa (x —a)" 


0. 
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PROOF Writing out P,¢(x) explicitly, we obtain 


n—| (i) 
f@) = 55 Le —a)' 
FO) Pra)” = Pe O) 


Ca a) Ona) n! 
It will help to introduce the new functions 


n—| fla) 
O(x) = » “>@), sand. iG) — (a) = 


i! 
i=0 


now we must prove that 


suf &) — OC ah'@) 
lim = , 


xa g(x) n! 


Notice that 


ONG) =f a asl 
g(x) =n!(x — a)” “/n —b)). 


Thus 
lim [ f(x) — O(@)] = f(a) — O(a) = 0, 
lim [f'@) — O'(@)] = f'(@ — Qa) = 9, 
lil foe O° @)| =f" @ 0" "@—0 
and 
lim g(x) = lima) g "(rc)" lim g(x) =i0) 


We may therefore apply ?Hopital’s Rule n — | times to obtain 


f(x) = Q(x) foe) -s oD) 
lim Se lim aaa” a aaa EEC 
x>a_ (x —a)?" xa n!(x —a) 


Since Q is a polynomial of degree n — 1, its (n — 1)st derivative is a constant; in 
fact, O"-Y(x) = f*-Y@). Thus 
F@) = Q(x) ieee) et f° @ 
ihn —$$ = him 
xa (x —a)" xa n! (x —@) 


and this last limit is f“(a)/n! by definition of f(a). § 


One simple consequence of ‘Theorem 1 allows us to perfect the test for local 
maxima and minima which was developed in Chapter 11. If a 1s a critical point 
of f, then, according to Theorem 11-5, the function f has a local minimum 
atta if of "(@) => 0} anda local maximum, ata@at f(@n= Osa, f(@)— One 


(a) n odd 


(b) n even 


PUG WR 2 
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conclusion was possible, but it is conceivable that the sign of f’’(a) might give 
further information; and if f’’(a) = 0, then the sign of f(a) = 0 might be 


significant. Even more generally, we can ask what happens when 


(*) fi@=f'@=---=f"%@=0, 
jf a 0. 


The situation in this case can be guessed by examining the functions 


(COS Gr =a 
g(x) = —(w—-a)", 


which satisfy (*). Notice (Figure 2) that if m is odd, then a is neither a local 
maximum nor a local minimum poimt for f or g. On the other hand, if n is 
even, then f, with a positive nth derivative, has a local mimimum at a, while 
g, with a negative nth derivative, has a local maximum at a. Of all functions 
satisfying (*), these are about the simplest available; nevertheless they indicate the 
general situation exactly. In fact, the whole point of the next proof is that any 
function satisfying (*) looks very much like one of these functions, in a sense that 
is made precise by Theorem 1. 


Suppose that 


f(a) —— f° M%a@) =i(), 
fia) ah (0. 


(1) If m is even and f(a) > 0, then f has a local minimum at a. 


l 
(2) If n is even and f’?(a) < 0, then f has a local maximum at a. 
3) I 


(3) 


f nis odd, then f has neither a local maximum nor a local minimum at a. 


There is clearly no loss of generality in assuming that f(a) = 0, since neither the 
hypotheses nor the conclusion are affected if f is replaced by f — f(a). Then, 
since the first 2 — | derivatives of f at a are 0, the ‘Taylor polynomial P,q of f 1s 


‘(a ") (q) 
Py a(x) — fla) SL res ao) ee aa Pak 
~(1) ; : 
= mb —a)". 
n! 


Thus, Theorem | states that 


mm Cee Co ea IO) | fg@ 
0 = lm ———— = lm | ——— —- —— ]. 
xa (x — a)" x>a] (x — a)" n! 

Consequently, if x is sufficiently close to a, then 
f(x) fe 
—~—— has the same sign as .———. 
(x — a)!" n! 


Suppose now that 7 1s even. In this case (x — a)” > 0 for all x 4 a. Since 
f (x)/(« —a)" has the same sign as f (a)/n! for x sufficiently close to a, it follows 
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that f(x) itself has the same sign as f"(a)/n! for x sufliciently close to a. If 
f(a) > O, this means that 


FO 40 =f (qi 


for x close to a. Consequently, f has a local minimum at a. A similar proof works 
for the case f(a) < 0. 
Now suppose that 1 is odd. ‘The same argument as before shows that if x is 


Peal ice : icie 7 se j = 
fw) é , ote O sufhiciently close to a, then 


f(x) 
(a) ————— always has the same sign. 

(x a, ay" é te 
But (x —a)" > O for x > a and (x—a)" < 0 for x <a. Therefore f(x) has different 
signs for x > a@ and x <a. ‘This proves that f has neither a local maximum nor 
a local minimum at a. J 


Although Theorem 2 will settle the question of local maxima and minima for 
just about any function which arises in practice, it does have some theoretical 
f@) =e ee x 7) limitations, because f(a) may be 0 for all k. This happens (Higure 3(a)) for the 
0, x=0 function 
(b) ee a ae = 
f(x) = 
0, a=, 


which has a minimum at 0, and also for the negative of this function (Figure 3(b)), 
which has a maximum at 0. Moreover (Figure 3(c)), if 


ent? eer) 
f@)= 4 0, x=0 


—et x <0, 


then f (0) = 0 forall k, but f has neither a local minimum nora local maximum 
at 0. 

The conclusion of Theorem 1 is often expressed in terms of an important con- 
cept of “order of equality.” ‘Two functions f and g are equal up to order 2 


al Gil Robs 


at aif 

. JS O)e si) 

lim ————— = 0 

v= (x — a)? 
In the language of this definition, ‘Theorem | says that the Taylor polynomial 
Pria.¢ equals f up to order n at a. The Taylor polynomial might very well have 
been designed to make this fact true, because there is at most one polynomial of 
degree < a with this property. This assertion is a consequence of the following 
elementary theorem. 


THEOREM 3 Let P and Q be two polynomials in (x — a), of degree < n, and suppose that P 
and Q are equal up to ordern at a. Then P = Q. 


proor = Let R = P — Q. Since R is a polynonual of degree <n, it is only necessary to 


COROLLARY 
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prove that if 
R(x) = bo feces Dax = aye 


satishes 
R(x) 
lim ———— = 
x—a (x — a)e 


then R = 0. Now the hypothesis on R surely imply that 


R(x) 
ie 


- Sor OPS; Zin 
x>a (x — aq)! 


For i = 0 this condition reads simply lim R(x) = 0; on the other hand, 
x—a 
lim Gm |g ee ie ae ee Dlx =a)" | 
X—a 9 ile af 
= bo. 


Thus bp = 0 and 
R(x) = bi —a)+---+5,(x — a)", 


Therefore, 


R(x) n—| 
=b; +bo(x —4a) + + b,(x — a) 
x—a 
and 
lim = Di. 
BoM Se = (7) 


Thus b; = 0 and 
A 
R(x) = bo(x — a) +++) +b, (x — a)". 
Continuing in this way, we find that 


bo=::-=b,=0.] 


Let f be n-times differentiable at a, and suppose that P is a polynomial in (x —a) 
of degree <n, which equals f up to order n at a. Then P = fina, f 


Since P and P,.g.¢ both equal f up to order n at a, it is easy to see that P equals 
Fra.f Wp to order n at a. Consequently, P = Pia.¢ by the Theorem. J 


At first sight this corollary appears to have unnecessarily complicated hypotheses: 
it might seem that the existence of the polynomial P would automatically imply 
that f is sufficiently differentiable for P.a.f to exist. But in fact this is not so. For 
example (Figure 4), suppose that 

Cpe x"tl y irrational 
/ 0, x rational. 
If P(x) = 0, then P is certainly a polynomial of degree < n which equals f up to 
order n at 0. On the other hand, f’(a) does not exist for any a #4 0, so f’(0) is 
undefined. 
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n+l 
b>) 


x x irrational 


0, x rational 


: if@)= 


FIGURE 4 


When f does have n derivatives at a, however, the corollary may provide a 
useful method for finding the ‘Taylor polynomial of f. In particular, remember 
that our first attempt to find the ‘Taylor polynomial for arctan ended in failure. 


‘The equation A oe 
arctan x = / —— dt 
9 1+t- 


suggests a promising method of finding a polynomial close to arctan—divide | 
9) . . . 
by 1 + ¢t-, to obtain a polynomial plus a remainder: 


l 


(<1 yn tl p2n+2 
1+? 


eet = PO cece mg eae 


1+ 


This formula, which can be checked easily by multiplying both sides by 1 + #7, 
shows that 


x pent2 


arctanx = [ PP eto rnd ay! f : 
. On thats 
x3 x? -2n+1 


According to our corollary, the polynomial which appears here will be the ‘Taylor 
polynomial of degree 2n + | for arctan at 0, provided that 


x pent+2 
dt 
| havea iS 


lim (). 
7201. antl 
Since 
x «2n+-2 x -|2n+3 
if dt / y2nt2 dt| = alas 
o I+ t? 0 2n+3 


this is clearly true. ‘Thus we have found that the ‘Taylor polynomial of degree 
2n + 1 for arctan at 0 is 


Ww 
wa) 


_2n+1 


sey pees 
cas Y Peel 


Xi 
P2n41,0(%) = x 2 
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By the way, now that we have discovered the ‘Yaylor polynomials of arctan, it is 
possible to work backwards and find arctan“) (Q) for all k: Since 


4 
r? 5 on+l 


() ’ bE ( 1)" 
P5,, Xx)=x-—4+—-.:-- oF =, 
ay Few n+ | 


and smee this polynomial is, by definition, 


9} D 
arctan'”(O) 5 aaretani2taak( Oem 


arctan (Oyeearctan') (0) + = ——__—* x7 4 : 
2! (2n +1)! 

we can find arctan (0) by simply equating the coefficients of x* in these two 
polynomials: 

arctan) (Q) a 

————— =() if k is even, 

k! 
arctan@/+D(Q)  (—1)! 


Ge) in ein arctan +) (0) = (=1)' - QD! 


A much more interesting fact emerges if we go back to the original equation 


sah = -2n+] x pont2 
arctanx =x — me + a ee + a + (=1)2e! i —— 7h 
3 a 2n+ | 0 I+ t- 


and remember the estimate 


x pont2 [xx [2n+3 
——~ dt | < ———~. 
i 142 2n+3 


When |x| < 1, this expression is at most 1/(2m + 3), and we can make this as 
small as we like simply by choosmg n large enough. In other words, for |x| < | 
we can use the Taylor polynomials for arctan to compute arctan x as accurately as we like. 
The most important theorems about Taylor polynomials extend this tsolated result 
to other functions, and the ‘Taylor polynomials will soon play quite a new role. 
The theorems proved so far have always examined the behavior of the ‘Taylor 
polynomial P,.¢ for fixed n, as x approaches a. Henceforth we will compare Taylor 
polynomials P,.q for fixed x, and different n. In anticipation of the coming theorem 
we mtroduce some new notation. 

If f is a function for which P,¢(x) exists, we define the remainder term 
Rna(x) by 


Te) = Pra) a Riya Ge) 
7 a) 


= f(a)+ 7 ays —ayter+ - 


(x — a)" + Rya(X). 


We would like to have an expression for Ry«(x) whose size is easy to estimate. 
There is such an expression, volving an integral, just as m the case for arctan. 
One way to guess this expression 1s to begin with the case nr = 0: 


fe) = fla) + Row(x). 
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The Fundamental Theorem of Calculus enables us to write 


f@)=f@ +f ~ Oat 


so that 
Ryan) = f f(t) dt. 


A similar expression for Rj,4(%) can be derived from this formula using integra- 
tion by parts in a rather tricky way: Let 


=f @) 


(notice that x represents some fixed number in the expression for v(t), so v(t) = 1); 


then : i 
i pinar= | iQ WW ds 
a a LY { 


u(t) v(t) 


and v(t)=t— x 


f(t — x) dt. 
y 
u(t) we) 


= WAHve) ~ 


Since v(x) = 0, we obtain 


fx) = f@+ [ fiat 
=) —wlayotay + f f’(t)(x —t)dt 


= f(a)+ f'(a\(x —a) +f f" (t)(x — t) dt. 


Thus e 
Riots) = | Ff" (t)(@ — t) dt. 


It is hard to give any motivation for choosing v(t) = t — x, rather than v(t) =f. 
It just happens to be the choice which works out, the sort of thing one might 
discover after sufficiently many similar but futile manipulations. 
now easy to guess the formula for R2.,(x). If 


However, it is 


m —(x — t)? 
De) =f and =v) = ew 
then v’(t) = (x — f), so 
i f(t)(x« —t) dt = u(t)v(t) -f f' @- at De 

ie. i — ae a . Oe eae 

‘This shows that 
x fOW) : 
oN CP) — 5 (x —t)* dt. 


You should now have little difficulty giving a rigorous proof, by induction, that 


LEMMA 
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if f+" is continuous on [a, x], then 


x (n+1) t 
Rng &) =| a = Oe dt. 


This formula is called the integral form of the remainder, and we can easily esti- 
mate it in terms of estimates for ff /nt on [a,x]. If mand M are the minimum 
and maximum of f@+) /n! on [a,x], then Ry @(x) satisfies 


xX x 
mf ae 71) df = Ry) = u [ (x —1)dt, 
a a 
sO we can write 
(x = qyitl 
n+] 


for some number @ between m and M. Since we've assumed that f“*) is con- 
tinuous, this means that for some f¢ in (a, x) we can also write 


OTe (x) = (os 6 


fo we (x 2 a)"t! feel) i 
Ry ee 4 f 
a(x) n! n+1 (n+ 1)! ee) 


which ts called the Lagrange form of the remainder (these manipulations will look 
familiar to those who have done Problem 13-23). 

The Lagrange form of the remainder is the one we will need in almost all 
cases, and we can even give a proof that doesn’t require f*) to be continuous 
(a refinement admittedly of little importance in most applications, where we ofien 
assume that f has derivatives of all orders). ‘This is the form of the remainder that 
we will choose in our statement of the next theorem (Taylor’s Theorem). 


Suppose that the function R is (n + 1)-times differentiable on [a,b], and 
Re @)=0 fork 0 e 
Then for any x in (a, b}] we have 


R(x) R&D) ; 
a = ee omic inne 
(x — a)ntl (n+ 1)! 
For n = 0, this is just the Mean Value T heorem, and we will prove the theorem 
for all n by induction on n. To do this we use the Cauchy Mean Value Theorem 
to write 
R(x) R'(Z) I R(z) 


© in (z —a)ttl 


@—ayt25 (n+ 2)(z —a)rtl 


for some z in (a,x), 


and then apply the induction hypothesis fo R’ on the interval la, z] to get 


R(x) RG) : ait 
a So for some ¢ in (a, z 
@—ay't2 n+? (+1)! 

R@+?) (1) 


~ (n +2)! 
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THEOREM 4 (TAYLOR’S THEOREM) — Suppose that f’,..., f*! are defined on [a,x], and that R,.q(x) is defined by 


2 ¢ a) 


nl (x al a)" + Reale 


f(x) = fla) + f'(ay(x —a)+- 


Then 
fetD@) 


Gn —a)"*! for some t in (a, oe) 


Noa (x ) — 


(Lagrange form of the remainder). 


PROOF The function R),q satisfies the conditions of the Lemma by the very definition of 
the ‘Taylor polynomial, so 


Rao. Ria ©) 
G Saye iG)! 


for some ¢t in (a,x). But 
(n+l) _  ¢(n+l1) 
rag f 5) 


since Ryq — f is a polynomial of degree n. 


Applying ‘Taylor’s Theorem to the functions sin, cos, and exp, with a = 0, we 
obtain the following formulas: 


3} “5 2n+1 at, (2n+2) 
: x x % sin (35 
snx =x — —+ — —---4+ (C1 ff th gy ee 
3! Sy (2n + 1)! (2n + 2)! 
2, 4 -2n nnwalon-- li) 
G x : COs (A) 5 
ose = DS =... eae re 7 ol 
thre 2! 4! i (2n)! m7 (2n + 1)! 
sp x” t 
PEE nh oe oe 
2! n! (n+ 1)! 


(of course, we could actually go one power higher in the remainder terms for sin 
and cos). 
Estimates for the first two are especially easy. Since 


|sin?”+)(¢)| < 1 for all t, 


we have 


> (2n+2) 2n+2 
sin (ft) Ont) |x | a 
1 < ——_. 

2n + 2)! 2n +2)! 

(2 + 2)! (2 as 2)! 

Similarly, we can show that 
9) 5) 

cos@"+) (zr) on [x |20+1 


g < ————_—. 
(2n + 1)! ~ (2n+ 1)! 
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These estimates are particularly interesting, because (as proved in Chapter 16) for 
any € > 0 we can make 


a 


een 
n!} 


by choosing n large enough (how large n must be will depend on x). This enables 
us to compute sinx to any degree of accuracy desired simply by evaluating the 
proper ‘Taylor polynomial P,9(x). For example, suppose we wish to compute 
sin 2 with an error of less than 1074. Since 


2n+2 


sin 2 = P,410(2)+R, where |R} < (4D! 


we can use P2,41,9(2) as our answer, provided that 
D2n+2 


Pee 
(Qn +2)! ~ 


A number n with this property can be found by a straightforward search-—it ob- 
viously helps to have a table of values for n! and 2” (see page 432). In this case it 
happens that n = 5 works, so that 


Si = Pijo(2) +R 
1 25 p/ Oe Qi 
eel aan 
where |R] < 107+. 


2 shel 3 


It is even easier to calculate sin | approximately, since 


sin] = P3,,1,90(1) +R, where sta (2n + 2)!" 


To obtain an error less than € we need only find an n such that 


| 
(rie °° 


and this requires only a brief glance at a table of factorials. (Moreover, the indi- 
vidual terms of P»,+1 9(1) will be easier to handle.) 


For very small x the estimates will be even easier. For example, 


| 


102#+2(2n + 2)! 


I | 
sin lo = Penn (=) a whereiR| < 


To obtain (R| < 107!9 we can clearly take n = 4 (and we could even get away 
with n = 3). These methods can actually be used to compute tables of sin and 
cos; a high-speed computer can compute P2,41,9(¥) for many different x in almost 
no time at all. Nowadays, computers, and even cheap calculators, determine the 
values of such functions “on-the-fly”, though by specialized methods that are even 
faster. 
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Estimating the remainder for e* is only slightly harder. For simplicity assume 
that x > O (the estimates for x < 0 are obtained in Problem 15). On the interval 
[O, x] the maximum value of e’ is e*, since exp is mereasing, so 


exxrt l 


Rio < , 
; (n+ 1)! 
Since we already know that e < 4, we have 


e yet l Ar ynt l 


(anni Gea 


which can be made as small as desired by choosing n sufficiently large. How large 
n must be will depend on x (and the factor 4° will make things more difficult). 
Once again, the estimates are easier for small x. If 0 < x < 1, then 
4) 
ee ae 4 


B= |e. ee he eee eR = 
2! n! (n+ 1)! 


] 
0O<R<=-— < —, 
5) ae 
sO 
i. wer | l | aan ] 
e=@ =e a >) pa dee where oe ap 
24 
which shows that 
2b Gras 
(This then shows that 
Bryn 
O2aR = —_—_ 
(1+ 1)! 
allowing us to improve our estimate of R slightly.) By taking n = 7 you can 


compute that the first 3 decimals for e are 
ahs a 


(you should check that 1 = 7 does give this degree of accuracy, but it would be 
cruel to insist that you actually do the computations). 

The function arctan is also important but, as you may recall, an expression for 
arctan (x) is hopelessly complicated, so that our expressions for the remainder 
are pretty useless. On the other hand, our derivation of the ‘Taylor polynomial for 
arctan automatically provided a formula for the remainder: 

x (29 yryentl (5 yrtl pn+2 
Wie Gy eves 
0 


arctan ¥ =x — — +---+ : 
ar Ue 


at. 
3 2n + | 
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As we have already estimated, 


% Ge ]yitl,2n42 x ae |x 2n+3 
| te = pete dp) 
0 1+t- 0 2n +3 


For the moment we will consider only numbers x with |x| < 1. In this case, the 


remainder term can clearly be made as small as desired by choosing n sufficiently 
large. In particular, 

oe (—1)" I 

arctan | = | -=+ 2 —-+--+——+R,_ where |R| < ———~. 

a 5 an + | 2n +3 
With this estimate it is easy to find an # which will make the remainder less than 
any preassigned number; on the other hand, # will usually have to be so large as to 
make computations hopelessly long. To obtain a remainder < 10~7, for example, 
we must take n > (107 — 3)/2. This is really a shame, because arctan | = 7/4, 
so the ‘Taylor polynomial for arctan should allow us to compute z. Fortunately, 
there are some clever tricks which enable us to surmount these difficulties. Since 

[x [2n+3 


R> (x)| < ———~,, 
|Ron+1,0(%)| m3 


much smaller #’s will work for only somewhat smaller x’s. ‘The trick for computing 
mw is to express arctan | in terms of arctan x for smaller x; Problem 6 shows how 
this can be done in a convenient way. 


From the calculations on page 413, we see that for x > 0 we have 


to 
eS) 
Ais 


n-lyn n 
a Re oe SOS 
4 H n+ | 
where 

ie 1)" yt 

n+] ce 

n+] ose. 
and there is a slightly more complicated estimate when —1 < x < 0 (Problem 16). 
For this function the remainder term can be made as small as desired by choosing 
n sufficiently large, provided that —1 < x < 1. 

The behavior of the remainder terms for arctan and f(x) = log(x + 1) 1s quite 

another matter when |x| > 1. In this case, the estimates 


|. ,|2n+3 
an +3 


n+l 
|Rn.o(x)| < AL | 


| Ron+1.9(*)| < for arctan, 


(x > 0) fore 


are of no use, because when > | the bounds x«”/im become large as m be- 


comes large. This predicament is unavoidable, and is not just a deficiency of our 


xX 


estimates. It is easy to get estimates in the other direction which show that the 
remainders actually do remain large. ‘To obtain such an estimate for arctan, note 
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that if ¢ is in [0, x] (or in [x, O] if x < 0), then 


er A ef I 


6) 
ponte 1 x x 2n4+l 
[ dt| > — / a a 
0 14+ + f? 2x2 | Jo 4n+6 
‘To get a similar estimate for log(] ++), we can use the formula 
l —])'e" 
See ee a pried ED 
l+t l+f 
to get 
x | x 2 x 3 x" 
log( +x =i Fe ig ey te ee ee Pe 
2 o +t V1 3 (mee n 
<1" | dt. 
Oral 


Ie > Olaicmator ¢ in [0, x] wehave 
l+4 Se 2 


so 


is 1” fie: | a 7 x" 
ake = LA) = — 
og Soe | OS 0 2n+2 


These estimates show that if |x| > 1, then the remainder terms become large as 
n becomes large. In other words, for 


x| > 1, the ‘Taylor polynomials for arctan 
and f are of no use whatsoever in computing arctan x and log(x + 1). This is no tragedy, 
because the values of these functions can be found for any + once they are known 
forvall secwatlin |x |e AL 


This same situation occurs in a spectacular way for the function 


es ent me so) 
te 0. =0) 


We have already seen that f ‘)(O) = O for every natural number k. ‘This means 
that the Taylor polynomial P,,.9 for f is 


aE @) 
fr OW EO 


n! 


P,o(x) = FO) + f'(O)x + 
=\()° 


In other words, the remainder term R,.9(«) always equals f(+), and the ‘Taylor 
polynomial is useless for computing f(x), except for x = 0. Eventually we will be 
able to offer some explanation for the behavior of this function, which is such a 
disconcerting illustration of the limitations of Vaylor’s ‘Vheorem. 

The word “compute” has been used so often in connection with our estimates 
for the remainder terni, that the significance of Taylor’s Theorem might be mis- 
construed, It is true that ‘Vaylor’s Theorem can be used as a computational aid 


THEOREM 5 


PROOF 


20. Approximation by Polynomial Functions 429 


(despite its ignominious failure in the previous example), but it has even more im- 
portant theoretical consequences. Most of these will be developed in succeeding 
chapters, but two proofs will illustrate some ways in which ‘Taylor’s Theorem may 
be used. The first illustration will be particularly impressive to those who have 
waded through the proof, in Chapter 16, that z is irrational. 


é 1s irrational. 


We know that, for any n, 


| l l 3 
— l a — — Chon — Gl el 
=e = eso as ay Re where Ose eens 
Suppose that e were rational, say e = a/b, where a and b are positive integers. 
Choose n > b and also n > 3. ‘Then 


a l 
on ae a Oe ca 
b Pay ae 


so 

nia ites jae i aia IR 
— =nitni+—4+---+—4n)7R,. 
b 2! n! 


Every term in this equation other than n!R,, 1s an integer (the left side is an integer 
because n > b). Consequently, n!R, must be an integer also. But 


(0) al tae 2a 
(n + 1)! 
Se) 
Cenk — See 
n+ 1 4 


which is impossible for an integer. §f 


The second illustration is merely a straightforward demonstration of a fact 


proved in Chapter 15: If 


Paes 0 
f(O) = 90, 
7 OL=W 


then f =0. To prove this, observe first that f“ exists for every k; in fact 


f =F) =—f, 
f= FO = Cf) =—f' =F 
FO =(fOY =f 


EUG: 
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This shows, not only that all if 2 exist, but also that there are at most 4 different 
ones: f, f’, —f, —f'. Since fC) = f’() = 0, all f (©) are 0. Now Taylor’s 


Theorem states, for any n, that 


Moe pete 
eS us =a) 


: a 5 / F : 4 4 A : 
for some t in {0, x]. Each function f“*) is continuous (since ft) exists), so for 
any particular x there is a number M such that 


pet Pay =< ior 04 <1 andl all 7 


(we can add the phrase “and all n” because there are only four different f’). 


‘Thus 
Mx |"t! 


[i Gos ee 


x|"/n! can be made as small as desired by 


Since this is true for every 1, and since 
choosing n sufficiently large, this shows that | f(v)| < ¢ for any e > 0; consequently, 
pir =O: 

Vhe other uses to which ‘Taylor’s Theorem will be put in succeeding chapters 
are Closely related to the computational considerations which have concerned us 
for much of this chapter. If the remainder term R,.¢(%) can be made as small as 
desired by choosing n sufficiently large, then f(*) can be computed to any degree 
of accuracy desired by using the polynomials P,¢(*). As we require greater and 
greater accuracy we must add on more and more terms. If we are willing to add 
up infinitely many terms (in theory at least!), then we ought to be able to ignore 
the remainder completely. ‘here should be “infinite sums” like 


1 Se x x? x! 
six =~ 3 tS =o te 
. xf ee celia 
COosSx = ~ oj a Le ee 
a x2 x3 xt 
Co — > 3a ae” 
ets is aaee 
arctan x =x —- ~ +—- — if lx 
- i = 
Wag a (le ees a 
og(l ++) =x 7 5 — i eae 1 Sin ace 


We are almost completely prepared for this step. Only one obstacle remains 
we have never even defined an infinite sum. Chapters 22 and 23 contam the 


necessary defimiuons. 
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PROBLEMS 


1. Find the ‘Taylor polynomials (of the indicated degree, and at the indicated 
point) for the following functions. 


(i) - FiGeiee"= deenee 3 at 0: 
Gi),  f@) Se” dearee 3. at 0. 
(iil) sin; degree 2n, at 5 

lv) cos; degree 2n, at m. 

Vv). .exp; degree. at I. 


( 

( 

(vi) log; degree n, at 2. 

(vii) f(x) =x? +x° +x; degree 4, at 0. 
( 


viii) f(x) = x°+x> + x; degree 4, at 1. 
l 
Gx) e7i@:)-= 7 degree 2n + 1, at 0. 


1 


Gx) fake 


; degree n, at 0. 


2. Write each of the followmg polynomials in x as a polynomial in (x — 3). (It 
is only necessary to compute the ‘Taylor polynomial at 3, of the same degree 
as the original polynomial. Why?) 


te > re 0), 


iv) ax*+bx-+c. 


3. Write down a sum (using >» notation) which equals each of the following 


numbers to within the specified accuracy. ‘To minimize needless computa- 
tion, consult the tables for 2” and n! on the next page. 


i) sim leerror — 10—. 
oe ° 54 [59) 
iM) esin2denton— On: 


l 


eee . —9} 
iii) sin >; error < 10729. 


iv) e; error < 10+. 


v)) *e*error ="100 
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me 


n rhe n! 
] 2 l 
2 4 2 
3 8 6 
4 16 94 
5 a2 120 
6 64 720 
q 128 5,040 
8 256 40,320 
9 2 362,880 
10 1,024 3,628,800 
11 2,048 39,916,800 
12 4,096 479,001,600 
i) 8,192 6,227,020,800 
14 16,384 87,178.29 1,200 
WS 32,768 1,307,674,368,000 
16 65,536 20,922,789,888,000 
17 oe OF 2 355,687,428 ,096,000 
18 262,144 6,402,373,705,728,000 
19 524,888 121,645,100,408,832,000 
20 1.048.576 2 432,902,008, 176,640,000 


This problem is similar to the previous one, except that the errors demanded 
are so small that the tables cannot be used. You will have to do a little 
thinking, and in some cases it may be necessary to consult the proof, in 
Chapter 16, that x”/n! can be made small by choosing n large - the proof 
actually provides a method for finding the appropriate 7. In the previous 
problem it was possible to find rather short sums; in fact, it was possible 
to find the smallest 2 which makes the estimate of the remainder given by 
‘LTaylor’s Theorem less than the desired error. But in this problem, finding any 
specific sum is a moral victory (provided you can demonstrate that the sum 
works). 


on 


. 10 
) sind -emert= 1020). 


1) @ePerror = 1Q— 1,000. 


. aids 


error < 107%. 


( 

( 

(iii) sin 10; error < 10779, 
(iv) 

( 


v) arctan 1; error < 1070"), 

(a) In Problem 11-41 you showed that the equation x? = cos. has pre- 
cisely two solutions. Use the third degree ‘Vaylor polynomial of cos to 
show that the solutions are approximately +,/2/3, and find bounds on 
the error. ‘Then use the fifth degree ‘Taylor polynomial to get a better 
approximation. 

(b) Similarly, estimate the solutions of the equation 2x* =w sin + cosa, 
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(a) Prove, using Problem 15-9, that 


XN i ] 

— = arctan — + arctan —, 

4 2 3 

54 A ] | 
— y= 4 arctan = — arctan ——. 
4 5 239 


(b) Show that 7 = 3.14159.... (Every budding mathematician should ver- 


ify a few decimals of 2, but the purpose of this exercise is not to set you 
off on an immense calculation. If the second expression in part (a) is 
used, the first 5 decimals for x can be computed with remarkably little 
work.) 


Suppose that a; and b; are the coefficients in the Taylor polynomials at a of f 
and g, respectively. In other words, a4; = f(a)/i! and bj = g(a)/i!. Find 
the coefficients c; of the Taylor polynomials at a of the following functions, 
in terms of the a;’s and b;’s. 


(iv) 


(v) 


(a) 


(b) 
(c) 


j +8. 
Be 


nos) = f fC) at. 


k(x) = | f(tydt. 
0 


Prove that the Taylor polynomial of f(x) = sin(x*) of degree 4n +2 at 0 


IS 
6 .10 yint2 


ee et +(-1)" 

cm by (2n + 1)! 
Hint: If P is the Taylor polynomial of degree 2n + 1 for sin at 0, then 
six = P(x)> R(x); where lim R(x)/x7"*! = 0. What does this imply 
about lim RCo Wa ae 


Find f (0) for all k. 
In general, if f(x) = g(x”), find f“ (0) in terms of the derivatives of g 
at 0. 


x 


The ideas in this problem can be extended significantly, in ways that are explored 
in the next three problems. 


we 


(a) 


Problem 7 (i) amounts to the equation 
Pha, fe — Pua, f a Py age. 
Give a more direct proof by writing 


f(x) = Pra, f eae = Rivas (x) 
g(x) = Pr ase (ey Knee (gy, 


and using the obvious fact about Ry.a.f + Rna.a.e- 
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10. 


11. 


(b) Similarly, Problem 7 (11) could be used to show that 
Pua, fe = (Peeae z lee alos 


where | P],, denotes the truncation of P to degree n, the sum of all 
terms of P of degree < n [with P written as a polynomial in x — a]. 
Again, give a more direct proof, using obvious facts about products in- 
volving terms of the form R,. 

(c) Prove that if p and g are polynomials in ..—a and him K(x) /@—a)" = 0, 
then es 


p(q(x) + R(x)) = p(q(x)) + R(x) 


where 
lim R(x)/(x —a)"=0 


Also note that if p is a polynomial in x — a having only terms of degree 
> n, and q 1s a polynomial in x — a whose constant term is O, then all 
terms of p(q(x —a)) are of degree > n. 

(d) If a=] 0 andih="e(ay= OMtlien 


P, aQvfe2—— — [earn o Teele 


(Problem 8 is a special case.) 
(e) ‘The same result actually holds for all a and any value of g(a). Hint: 
Consider F(x) = f(x+e(a)), G(x) = g(x +a) and H (x) = G(x) g(a). 
(f) Lf g(a) =0, then 


fiaegl = [1 +e Pn.a.g te iP, op) aL aia (Peay 


Aa 


For the followmg applications of Problem 9, we assume a = 0 for simplicity, 
and just write P,,¢ mstead of Py a, ¢. 


(a) Por Goi, Samcee (x) = sinx tnid Ps 7a ey). 

(b) For the same f and g, find Ps, rg. 

(c) Find P5tan(x). Hint: First use Problem 9 (f) and the value of Ps ¢os(x) to 
find Ps /jcoseoeeniswer: x + = + - 

(d) Pind* Py ici ce — e** cosx. (Answer: 1 + 2x + aa + zx _ x") 

(ec) Find Ps, for f(x) = sinx/cos 2x. (Answer: x + 4 a ae 30h x 2) 


(f) Fmid Pé peor 7 = x /( + .x2)e*]. (Answer: . —x'- sx? + > x°) 


Calculations of this sort may be used to evaluate limits that we might other- 
wise try to find through laborious use of PH6pital’s Rule. Find the following: 
. =I 
ee Yr NG) 


(a) lana ——-— = In ; 
x30 x —sm7v 20D) 


Hint: Mirst find P39.y(¥) and P39. p(x) for the numerator and denomi- 
nator N(@&) and Dw). 


12. 


13. 


14. 
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e* 


(b) lm ae : 
x0 x —sinx 


aD) 
= A 


Hint: For the term e*/(1+2), first write 1/(1+x) = 1—x+x2—x34---. 


fe\e li ( | l ) 
c) lm ——)}. 
x>0\sin?x x? 


1 — cos(x7) 


roll) Wt 
id) x>0 x2 sin? x 

1 | 
(e) lim — 


mo) BAe * 
x0 Siete 9 sin(x-) 
. 9) 
(sin x)(arctan x) — x* 


(f) lim 


x30 1 — cos(x2) 


Let 
sin x AO 
ly, c= 'l: 


Starting with the ‘Taylor polynomial of degree 2n + 1 for sin x, together with 


Ae = 


the estimate for the remainder term derived on page 424, show that 


x2 x4 x2n 
Ac3 = (: = o> fel a Hel pT PRO) pC) 


3! 5! (2n + 1)! 
where 
\R j e (x |22*1 
on. 0. ¢(x)| < —— 
nel (2n +2)! 


and use this to conclude that 


ee 1703 
— x= — BH 94 
[is ~f (1-3 re 5) 1703. 946 


with an error of less than 107°. 


Let 


f(x) = i 
i i= 10). 


(a) Find the Taylor polynomial of degree n for f at 0, compute f“ (0), and 
give an estimate for the remainder term R,, 0, f. 


(b) Compute / f with an error of less than 1074, 
0 


0.1 
. 2) . ~ 
Estimate / exp(x~) dx with an error of less than 107. 
0 
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ID: 


16. 


a We 


18. 


Lo: 


Prove that if x <0, then the remainder term R, 9 for e* satisfies 


[x [art 


Ea) S$ 
‘ (2 + 1)! 
Prove that if —I| < x < O, then the remainder term R,.9 for log(1 +x) 
satishes 

ea 


if = “Wie Gl en eae 

ae (ih4-&) Gr-l) 

(a) Show that if |g’(x)| < Mlx — a|" for |x — a| < 6, then |g(x) — g(a)| < 
M32 al ey 4 1) ford = ele oF 


(b) Use part (a) to show that if lim g’(v)/(« — a)" = 0, then 


. LeMi— oa 
hm ee 


x>a (x — a)ntl 


(c) Show thamiiget) = ((x) — PF, ay (x), then ¢ Gal — 9 Cee 


(d) Give an inductive proof of Theorem 1, without using ?H6pital’s Rule. 


Deduce Theorem 1 as a corollary of ‘Taylor’s ‘Theorem, with any form of 
the remainder. (The catch is that it will be necessary to assume one more 
derivative than in the hypotheses for Theorem 1.) 


Lagrange’s method for proving ‘Taylor’s Theorem used the following device. 
We consider a fixed number x and write 


(n) t) 
aa Py — 1)" + S(t) 


(*) fOy= FO) + fO@-—H+--- 
for S(t) = Ry (x). The notation is a tip-off that we are going to consider the 
right side as giving the value of some function for a given ¢, and then write 
down the fact the derivative of this function 1s 0, since it equals the constant 
function whose value is always f(x). To make sure you understand the roles 
of x and rt, check that if 


*(k) 
(t . 
= J z Sterna 
then 
*(k) t (k+1) , 
2@) = J -; ee = wt ee fu =a) 

“(k) f . (k+1) , 
tol A? See Sey 


(k — 1)! ane 


20. 
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(a) Show that 


wth t 
i ee. [=r + uP Te — 7) 


1! 
i = an Sie LO =) 
hee 
+ S'(t), 
and notice that everything collapses to 
S(@)=— eel =)". 


Noung that 
S(x) = Ryx(x) = 0. 


S(a) = Raa Car 


apply the Cauchy Mean Value Theorem to the functions S and h(t) = 
(x —t)"*! on [a,x] to obtain the Lagrange form of the remainder 
(Lagrange actually handled this part of the argument differently). 

(b) Similarly, apply the regular Mean Value Theorem to S to obtain the 
strange hybrid formula 


7 fg 


ee nee) 
Ny 


(x —t)"(x -—a). 


This is called the Cauchy form of the remaimder. 


Deduce the Cauchy and Lagrange forms of the remainder from the integral 
form on page 423, using Problem 13-23. There will be the same catch as m 


Problem 18. 


I know of only one situation where the Cauchy form of the remainder is used. 


The next problem is preparation for that eventuality. 


21. 


kor every number a, and every natural number n, we define the “binomial 
coefficient” 


(j)-“ eee 


n n! 
= a ae c CEN 
and we define abo I, as usual. If @ is not an integer, then is never Q, 
n 
and alternates in sign for > a. Show that the Taylor polynomial of degree n 


for 7 way Oh x) art O1s8 Py (x)= » fi and that the Cauchy and 
k=0 


Lagrange forms of the remamider are the following: 
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223 


Ze 


Cauchy form: 


a(a—1)-...-(a—n) 


Rno(x) = ———— | “aoe Sr Hol) ae an 
a(a—|)-...-(a—n) (et) 

= arena bun) eee 

n} ieee 


ear n 
(n + (, i ,)x +f \oou (FS) . me foametOe) om (x, 0): 


Lagrange form: 
a(a—1)-...-(@a—n) \ ae | 
R a ra | 1)" n 
ol) ae woe Roem (tert) 


= ie jet ny TN si OB) One (pO): 


Estmates for these remainder terms are rather difficult to handle, and are 
postponed to Problem 23-21. 


(a) Suppose that f is twice differentiable on (0, 00) and that |f(x)| < Mo 


for all x > O, while |f”’(x)| < Mo for all x > 0. Use an appropriate 
Taylor polynomial to prove that for any x > 0 we have 


5 a 
F's SMy+5M2 — forall h > 0. 
1 z 


(b) Show that for all x > 0 we have 


If’) < 2 MoM. 
Hint: Consider the smallest value of the expression appearing in (a). 
(c) If f is twice differentiable on (0,00), f” 1s bounded, and f(x) ap- 
proaches 0 as x — oo, then also f’(x) approaches 0 as x > oo. 
(dit lim Scaitesists and “im f(x) emsts, then lim 77@) = "im 7 G,) = 
> OX MAES, Xx—70O 2 Sr Ale, ©. 
0. (Compare Problem 11-34.) 
(a) Prove that if f”(a) exists, then 


: ; ee ee ee a 
7 (ay— hin AG Sign aid) ei) ) Jia » IM ) 
h—O R= 
The limit on the right is called the Schewvarz second derivative of f ata. Hint: 
Use the Taylor polynomial P).4(x) with x =a-+h and with x =a — Ah. 
(b) Let #G@a— x? for x > 0, and —x? for x < 0. Show that 


m0 1") + OR aie (0) 
hn, .——_—_—— 
h>0 Ue 


exists, even though f”(0) does not. 
(c) Prove that if f has a local maximum at a, and the Schwarz second 
derivative of f at a’ ¢xists, then it is < 0) 


24. 


a2 5. 


#726; 
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(d) Prove that if f’’(a) exists, then 


1) . flath)— fta—h) —2hf'(a) 
— = lm A. 
5 h—-0O h3 


Use the ‘Taylor polynomial Pj,4,¢, together with the remainder, to prove a 
weak form of Theorem 2 of the Appendix to Chapter Il: If f” > 0, then 
the graph of f always les above the tangent line of f, except at the point 
of contact. 


Problem 18-43 presented a rather complicated proof that f = Oif f”—f = 0 
and f(0) = f’(0) = 0. Give another proof, using ‘Taylor’s Theorem. (This 
problem is really a preliminary skirmish before doing battle with the general 
case in Problem 26, and is meant to convince you that Taylor’s Theorem is 
a good tool for tackling such problems, even though tricks work out more 
neatly for special cases.) 


Consider a function f which satisfies the differential equation 


n—| 


7° = > afm 


j=0 


for certain numbers dg, ...,4@,—1. Several special cases have already received 
detailed treatment, either in the text or in other problems; in particular, we 
have found all functions satisfying f’ = f, or f" +f = 0, or f”— f =0. The 
trick in Problem 18-42 enables us to find many solutions for such equations, 
but doesmt say whether these are the only solutions. ‘This requires a unequeness 
result, which will be supplied by this problem. At the end you will find some 
(necessarily sketchy) remarks about the general solution. 


(a) Derive the following formula for ft (let us agree that “a_,” will be 0): 


n—1 


eC ey 


j=0 


: ; z 
(b) Deduce a formula for fT’. 


The formula in part (b) is not going to be used; it was inserted only to con- 
f"*® js out of the question. On the 
other hand, as part (c) shows, it is not very hard to obtain estimates on the 
size"or f(x). 


vince you that a general formula for . 


(co) (Let = max(laldol...0. ld). When (aj27 + a,_-7¢@)| = 2N?; this 
means that 
n—| 
fends SD. where bj" = INP. 


fo) 
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(d) 


Show that 
n—1 


fo = yer where |b;*| < 4N?, 
j=0 


and, more generally, 


n—1| 


ee) = pI where |bj*| < Ok NATL 
j=0 


Conclude from part (c) that, for any particular number x, there is a 
number M such that 


[f° (x) < M- Des forall ke 
Now suppose that f(0) = f/(0) =---= f"-D(0) = 0. Show that 
M . Wad IN Sea alae 2 M. I2Nx |?+k+1 
(n+k-+1)! ~— (n+k+1)! 


and conclude that f = 0. 
Show that if f; and fo are both solutions of the differential equation 


lf(x)| < 


n—1| 


f® = an. 
7—=0 
and f;“)(0) = fo“ (0) for 0 < j <n —1, then fj = fo. 


In other words, the solutions of this differential equation are determined 
by the “initial conditions” (the values f/)(0) for 0 < j <n -—1). This 
means that we can find all solutions once we can find enough solutions 
to obtain any given set of initial conditions. If the equation 


l 


} 


x” —a,_{x" — +++ -ag=90 


has n distinct roots @|,..., @,, then any function of the form 
f(x) = Ge ria) te Che ts 
is a solution, and 


f (O) = C] ap 29 2S Gar 
f'(O) = AC] +--+ + QnCn, 


AO) — ay” ley AE eda! en Thee. 


As a matter of fact, every solution is of this form, because we can obtain 
any set of numbers on the left side by choosing the c’s properly, but we 
will not try to prove this last assertion. (It is a purely algebraic fact, which 
you can easily check for n = 2 or 3.) ‘These remarks are also true if some 


a2. 


(a) 
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of the roots are multiple roots, and even in the more general situation 
considered in Chapter 27, 


Suppose that f is a continuous function on [a,b] with f(a) = Fb) 
and that for all x in (a,b) the Schwarz second derivative of f at x is 0 
(Problem 23). Show that f is constant on [a,b]. Hint: Suppose that 
f(x) > f(a) for some x in (a, b). Consider the function 


8(x) = f(x) — e(x —a)(b—x) 


with g(a) = g(b) = f(a). For sufficiently small ¢ > 0 we will have 
8(x) > g(a), so g will have a maximum point y in (a,b). Now use 
Problem 23(c) (the Schwarz second derivative of (x —a)(b— x) is simply 
tts ordinary second derivative). 

If f is a continuous function on [a, b] whose Schwarz second derivative 
is 0 at all points of (a, b), then f is linear. 


Let f(x) = x*sin 1/x? for x #0, and f(0) = 0. Show that f =0 up to 
order 2 at 0, even though f”(0) does not exist. 


This example is slightly more complex, but also slightly more impressive, 
than the example in the text, because both f'(a) and f”(a) exist for 
a #0. Thus, for each number a there is another number m(a) such that 


m(a) 


2 


(*) f@) = f(a)+ f(a —a)t+ (x — a)? + R,(x), 


SHEE 

where lim = = 

x>a (x — a) 
namely, m(a) = f”(a) for a £0, and m(0) = 0. Notice that the function 
m defined in this way is not continuous. 
Suppose that f is a differentiable function such that (*) holds for all a, 
with m(a) = 0. Use Problem 27 to show that f’(a) = m(a) = 0 for 
all a. 
Now suppose that (*) holds for all a, and that m is continuous. Prove 
that for all a the second derivative f(a) exists and equals m(a). 


CCL Laas 


€é IS TRANSCENDENTAL 


‘The irrationality of e was so easy to prove that in this optional chapter we will 
attempt a more difficult feat, and prove that the number e is not merely irrational, 
but actually much worse. Just how a number might be even worse than irrational 
is suggested by a shght rewording of definitions. A number x is irrational if it is 
not possible to write x = a/b for any integers a and b, with b 4 0. This is the 
same as saying that x docs not satisfy any equation 
bx -—a=0 

for integers a and b, except for a = 0, b = 0. Viewed in this light, the irrationality 
of V2 does not seem to be such a terrible deficiency; rather, it appears that V2 just 
barely manages to be irrational—although V2 is not the solution of an equation 


ayx +ag = 0, 


it 7s the solution of the equation 


of one higher degree. Problem 2-18 shows how to produce many irrational num- 
bers x which satisfy highcr-degree cquations 


Git ale ssi =F tae + ag — OE 


where the a; are integers not all 0. A number which satisfies an “algebraic” cqua- 
tion of this sort 1s called an algebraic number, and practically every number we 
have ever encountered is defined in terms of solutions of algebraic equations (7 
and e are the great exceptions in our limited mathematical experience). All roots, 


V2, BolT, 


are clearly algebraic numbers, and even complicated combinations, like 


O54) It 2 ie 


are algebraic (although we will not try to prove this). Numbers which cannot be 


such as 


obtained by the process of solving algebraic equations are called transcendental; 
the main result of this chapter states that e is a number of this anomalous sort. 
The proof that ¢ is transcendental is well within our grasp, and was theoretically 
possible even before Chapter 20. Nevertheless, with the inclusion of this proof, we 
can justifiably classify ourselves as something more than novices in the study of 
higher mathematics; while many irrationality proofs depend only on elenientary 
propertics of numbers, the proof that a number is transcendental usually involves 
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some really high-powered mathematics. Even the dates connected with the tran- 
scendence of e are nnpressively recent—the first proof that e is transcendental, 
due to Hermite, dates from 1873. The proof that we will give is a simplification, 
due to Hilbert. 

Before tackling the proof itself, it is a good idea to map out the strategy, which 
depends on an idea used even in the proof that e is irrational. ‘Two features of the 


expression 
| | | | ® 
e= cee, OT n 
were important for the proof that e is irrational: On the one hand, the number 
| 
fe 
|! n! 


can be written as a fraction p/q with q <n! (so that n!(p/q) 1s an mteger); on the 
other hand, 0 < R, < 3/(n + 1)! (so n!R, 1s not an integer). ‘These two facts show 
that e can be approximated particularly well by rational numbers. Of course, every 
number x can be approximated arbitrarily closely by rational numbers—if e > 0 
there is a rational number r with | —r| < ¢; the catch, however, is that it may be 
necessary to allow a very large denominator for r, as large as 1/e perhaps. For e 
we are assured that this is not the case: there is a fraction p/q within 3/(n + 1)! 
of e, whose denominator g is at most n!. If you look carefully at the proof that e 
is irrational, you will see that only this fact about e is ever used. ‘The number e is 
by no means unique in this respect: generally speaking, the detler a number can be 
approximated by rational numbers, the worse it is (some evidence for this assertion 
is presented in Problem 3). ‘The proof that e is anscendental depends on a natural 
extension of this idea: not only e, but any finite number of powers e, e7, ... , e”, 
can be simultaneously approximated especially well by rational numbers. In our 
proof we will begin by assuming that e is algebraic, so that 


(*) dpe" +++» +ajetag=0. ap 4#O0 


for some mntegers ag, ... , Gr. In order to reach a contradiction we will than find 
certain integers M, M,.... M, and certain “small” numbers €1, ... , €, such that 
a! = M, + Ge] 
i 
) M> ae) 
e7 = ——., 
M 
pikes My + €n 
va 


Just how small the €’s must be will appear when these expressions are substituted 
into the assumed equation (*). After multiplying through by M we obtain 


|agM +a,M, =e + ayM,| am ara Sipe? sin En Qi | = 0. 
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THEOREM 1 


PROOF 


The first term in brackets is an integer, and we will choose the M’s so that it will 
necessarily be a nonzero integer. We will also manage to find e€’s so small that 


leqay Sr: oe = en << 53 


this will lead to the desired contradiction- the sum of a nonzero integer and a 
number of absolute value less than } cannot be zero! 


As a basic strategy this is all very reasonable and quite straightforward. ‘The 
remarkable part of the proof will be the way that the M’s and e’s are defined. In 
order to read the proof you will need to know about the gamma function! (This 
function was introduced in Problem 19-40.) 


e is transcendental. 


Suppose there were integers dg, ... , dn, with ag 4 0, such that 


1 


() ane” + aye" +---+ag = 1). 


Define numbers M, My, ... , M, and €1,... , €) as follows: 


ole oI (74 al . : Salen 
ue [ xP"[@ —1)-...-( —n)]?e a 
0 


. 


(= Pb) 
(oe) -1 _ 7 : Pe \ Peak 
Pia al xP (a — eee ( — 2 dx. 
k pk)! 
kp an Pe p~x 
ae i eee Se. 
0 (aS): 


The unspecified number p represents a prime number* which we will choose later. 
Despite the forbidding aspect of these three expressions, with a little work they will 
appear much more reasonable. We concentrate on M first. If the expression in 
brackets, 


[(x —1)-...-@—n)], 
is actually multiplied out, we obtain a polynomial 


x" +..-tn! 


* The term “prime number” was defined in Problem 2-17. An important fact about prime numbers 
will be used in the proof, although it is not proved in this book: If p is a prime number which docs 
not divide the integer a, and which does not divide the integer b, then p also does not divide ab. 
The Suggested Reading mentions references for this theorem (which is crucial in proving that the 
factorization of an integer into primes is unique). We will also use the result of Problem 2-17(d), 
that there are infinitely many primes~~the reader is asked to determine at precisely which points this 
information is required, 
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with integer coefficients. When raised to the pth power this becomes an even 
more complicated polynomial 


xP +... (m!)P 


Thus M can be written in the form 


np 1 Bs, 
a See Pte sda 
lay 6 


where the Cy, are certain integers, and Cp = +(n!)?. But 


[ee] 
/ Kec de—k'. 
0 


‘Thus 
np 
a Sere) 
M = eG ale eae, 
Now, for aw = 0 we obtain the term 
— 1)! 
ene = = s(n). 
(p — 1)! 


We will now consider only primes p > n; then this term is an integer which is not 
divisible by p. On the other hand, if @ > 0, then 


(p—1+a)! 
(p— 1)! 


which vs divisible by p. ‘Therefore M itself is an integer which 1s not divisible by p. 
Now consider M;. We have 


co pl = ' : ot [dep —ee 
i= é f x [a= Dinw.aeie nize du 
k 


=—C.(p +a — ))\(p pa 2)e 


Qa 


(pi A)! 
Cop — lias = ‘ wiis2 — }D ACA.) 
=|! x iG Sb) st 3 Cea) Re a 
k (p — 1)! 


This can be transformed into an expression looking very much lke M by the 
substitution 


=~ — Kk 
du = dx. 


The limits of integration are changed to 0 and ov, and 


iN (atk) [u+tk— le... GER) Per 


Wie 
‘ 0 (p — 1)! 


du. 


There is one very significant difference between this expression and that for M. 
The term in brackets contains the factor u in the kth place. Thus the pth power 
contains the factor u’?. ‘This means that the entire expression 


utk?"[ut+k —1)-...-(u+k—n)]? 
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is a polynomial with integer coefficients, every term of which has degree at least p. 
Thus 


up np 


| (pl om! 
M, = Lf), yP- teem dy = De ; 
; LG ie dX (p— DL 


where the Dy are certain integers. Notice that the summation begins with aw = 1; 
in this case every term in the sum is divisible by p. Thus each M, is an integer 
which zs divisible by p. 

Now it 1s clear that 


M, + €, 
oie ee Ske ec eects 
M 


Substituting into (*) and multiplying by M we obtain 
[agM co a,M, oa rate: + anM,,| 4 [ayey + ea a An En | => 0. 


In addition to requiring that p > 7 let us also stipulate that p > fag|. This means 
that both M and ag are not divisible by p, so agM 1s also not divisible by p. Since 
each M, is divisible by p, it follows that 


agM +a,;M,+---+a,M, 


is not divisible by p. In particular it is a nonzero integer. 
In order to obtain a contradiction to the assumed equation (*), and thereby 
prove that e is transcendental, it is only necessary to show that 


laye| a a eer | 


can be made as small as desired, by choosing p large enough; it is clearly sufficient 
to show that each |e,| can be made as small as desired. This requires nothing more 
than some simple estimates; for the remainder of the argument remember that 7 
is a certain fixed number (the degree of the assumed polynomial equation (*)). ‘To 
begin with, if | <k <n, then 


1 seg Poe Ur . Po ale P| o-* 
ee éf |x [x«-—1)-...-@—nvn)]?le He 
0 (p — 1)! 
fs wm le = 1) Ge heme 
Se ——— i ie sae 
0 (p- 1)! 
Now let A be the maximum of |(v — 1)-...- (x —”)| for x in [0,2]. Then 


e™nP-l AP n 
C= e al x 
(p—1)! Jo 


ene TAR pe ~ 
< ——__ Cnn 
(p—-1)! Jo 


et Pl ap 

(pa 

NP AP e" (nA)? 
ee 
~ @e le Wed! 
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But 2 and A are fixed; thus (7 A)?/(p — 1)! can be made as small as desired by 
making p sufficiently large. J 


‘This proof, like the proof that z is irrational, deserves some philosophic af- 
terthoughts. At first sight, the argument seems quite “advanced” —after all, we 
use integrals, and integrals from 0 to oo at that. Actually, as many mathemati- 
clans have observed, integrals can be eliminated from the argument completely; 
the only integrals essential to the proof are of the form 


for integral k, and these integrals can be replaced by k! whenever they occur. 
Thus M, for example, could have been defined initially as 


np 
(p-—Il+a)! 
M — Cy ————_-.. 
2 Cn) 


where Cy are the coefficients of the polynomial 
ae alee. (ie epi 


If this idea is developed consistently, one obtains a “completely elementary” proof 
that e is transcendental, depending only on the fact that 


l | l 
ah ao a es . 

Unfortunately, this “elementary” proof is harder to understand than the original 
one—the whole structure of the proof must be hidden just to eliminate a few 
integral signs! ‘This situation is by no means pecuhar to this specific theorem— 
“elementary” arguments are frequently more difficult than “advanced” ones. Our 
proof that z is irrational is a case in point. You probably remember nothing 
about this proof except that it involves quite a few complicated functions. There is 
actually a more advanced, but much more conceptual proof, which shows that z 
is ranscendental, a fact which is of great historical, as well as intrinsic, interest. One 
of the classical problems of Greek mathematics was to construct, with compass 
and straightedge alone, a square whose area is that ofa circle of radius 1. This 
requires the construction of a line segment whose length is /7, which can be 
accomplished if a line segment of length 7 1s constructible. The Greeks were 
totally unable to decide whether such a line segment could be constructed, and 
even the full resources of modern mathematics were unable to settle this question 
until 1882. In that year Lindemann proved that z 1s transcendental: since the 
length of any segment that can be constructed with straightedge and compass can 
be written in terms of +, -, —, +, and / , and is therefore algebraic, this proves 
that a line segment of length az cannot be constructed. 

The proof that z is transcendental requires a sizable amount of mathematics 
which is too advanced to be reached in this book. Nevertheless, the proof is not 
much more difficult than the proof that e is transcendental. In fact, the proof 
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for z is practically the same as the proof for e. This last statement should certainly 
surprise you. ‘The proof that e is transcendental seems to depend so thoroughly 
on particular properties of e that it is almost inconceivable how any modifications 
could ever be used for 2; after all, what does e have to do with 2? Just wait and 
see! 


PROBLEMS 


1. (a) Prove that if a > 0 is algebraic, then Ja is algebraic. 
(b) Prove that if @ is algebraic and r is rational, then @ + r and ar are 
algebraic. 


Part (b) can actually be strengthened considerably: the sum, product, 
and quotient of algebraic numbers is algebraic. ‘This fact 1s too difficult 
for us to prove here, but some special cases can be examined: 


2. Prove that V2 + V3 and V2(1 ap V3) are algebraic, by actually finding 


algebraic equations which they satisfy. (You will need equations of degree 4.) 


*3. (a) Let @ be an algebraic number which is not rational. Suppose that @ 
satisfies the polynomial equation 


es) = Ce oF aa Ae TAQ — 0, 


and that no polynomial function of lower degree has this property. Show 
that f(p/q) # O for any rational number p/q. Hint: Use Prob- 
lem 3-7(b). 

(b) Now show that | f(p/q)| = 1/q” for all rational numbers p/q with q > 0. 
Hint: Write f(p/q) as a fraction over the common denominator q”. 

(c) Lém7e=istip{ | f')\°o|x'=0a| < 1}. Wsethe Mlean-Valnertileorem 
to prove that if p/g is a rational number with ja — p/g| < 1, then 
la — p/q| > 1/Mq”. (It follows that for c = min(1,1/M) we have 
la — p/q| > c/q” for all rational p/q.) 


ra. Let 
a = 0.1 1000 LOOODDDODD000000000 1000... , 


where the I’s occur in the 7! place, for each n. Use Problem 3 to prove that 
@ is transcendental. (For each n, show that @ is not the root of an equation 
of degree n.) 


Although Problem 4 mentions only one specific transcendental number, it should 
be clear that one can easily construct infinitely many other numbers @ which do 
not satisfy |a — p/q| > e/g" for any ¢ and n. Such numbers were first considered 
by Liouville (1809-1882), and the inequality in Problem 3 is often called Liouville’s 
inequality. None of the transcendental numbers constructed in this way happens to 
be particularly iteresting, but for a long ime Liouville’s transcendental numbers 
were the only ones known. ‘Vhis situation was changed quite radically by the work 
of Cantor (1845-1918), who showed, without exhibitmg a single transcendental 


21. e is Transcendental 449 


number, that most numbers are transcendental. ‘The next two problems provide an 
introduction to the ideas that allow us to make sense of such statements. ‘The basic 
definition with which we must work is the following: A set A is called countable 
if its elements can be arranged in a sequence 


Gilinss QF Gdns « 


The obvious example (in fact, more or less the Platonic ideal of) a countable set 
is N, the set of natural numbers; clearly the set of even natural numbers is also 
countable: 


2,40, Se. 3: 


It is a httle more surprising to learn that Z, the set of all integers (positive, negative 
and Q) is also countable, but seeing is believing: 


Wr ie A eS 


The next two problems, which outline the basic features of countable sets, are 
really a series of examples to show that (1) a lot more sets are countable than one 
might think and (2) nevertheless, some sets are not countable. 


*5. (a) Show that if A and B are countable, then so is AUB = {x : x isin A or 
xism B}. Hmt: Use the same trick that worked for Z. 

(b) Show that the set of positive rational numbers is countable. (This is really 

quite startling, but the figure below mdicates the path to enlightenment.) 


1 1 i 1 1 
- /* Ha ee 5 
2 2 z 2 2 
1 ya 4 5 
3 3 3 3 3 
1 2 3 4 5 


(c) Show that the set of all pairs (m,n) of integers is countable. (This is 
practically the same as part (b).) 


(d) If Ay, Az, A3,... are each countable, prove that 
Aj U Ao AgUiye 


is also countable. (Again use the same trick as m part (b).) 

(ce) Prove that the set of all triples (/, m,n) of integers is countable. (A triple 
(1, m,n) can be described by a pair (/,m) and a number n.) 

(f) Prove that the set ofall n-tuples (a). a2,.... ay) is countable. (If you have 
done part (e), you can do this, usmg induction.) 

(g) Prove that the set of all roots of polynomial functions of degree n with 
integer coeflicients 1s countable. (Part (f) shows that the set of all these 
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*6. 


polynomial functions can be arranged in a sequence, and each has at 


most 7” roots.) 


(h) Now use parts (d) and (g) to prove that the set of all algebraic numbers 


is countable. 


Since so many sets turn out to be countable, it is important to note that the 


set of all real numbers between O and 1 is nof countable. In other words, 


there is no way of listing all these real numbers in a sequence 


a; = 0.a)1a12a13@14... 
a7 = 0.a21a22a23a24... 
a3 = 0.a31032033034... 


(decimal notation 1s bemg used on the right). ‘To prove that this 1s so, suppose 


such a list were possible and consider the decimal 


0.41 1422033444..., 


where tam— 5 1! aj,eAeeand @,, = Gal aq, =) Show that this mumber 


cannot possibly be in the list, thus obtamimg a contradiction. 


Problems 5 and 6 can be summed up as follows. ‘The set of algebraic numbers 
is countable. If the set of transcendental numbers were also countable, then the 


set of all real numbers would be countable, by Problem 5(a), and consequently the 
set of real numbers between 0 and | would be countable. But this is false. Thus, 
the set of algebraic numbers is countable and the set of transcendental numbers 


is not (“there are more transcendental numbers than algebraic numbers”). ‘The 


remaining two problems illustrate further how important it can be to distinguish 


between sets which are countable and sets which are not. 


7 


Let f be a nondecreasing function on [0,1]. Recall (Problem 8-8) that 
lim. f (Ga) ane lime f (2c) both exist. 


x—at Xa 


(a) For any ¢ > O prove that there are only finitely many numbers a in 


(0, T]with® me fv) — hm f(iey> e Hint? There arejintact, at niost 


x—=at : Xa 
LPC) 9 (O72 of them. 
Prove that the set of pomts at which /f is discontinuous is countable. 
Hint: If lim f(x) — lm f(x) > 0, then it is > 1/n for some natural 


Ber a BS Xe 


number n. 


This problem shows that a nondecreasmg function is automatically con- 
tinuous at most pomts. For differentiability the situation is more difficult 
to analyze and also more interesting. A nondecreasing function can fail 
to be differentiable at a sct of pomts which is not countable, but it is still 
true that nondecreasing functions are differentiable at most points (in a 
different sense of the word “most’). Reference [38] of the Suggested 
Reading eives a proof using the Rising Sun Lemma of Problem 8-20. 


*8. 


(a) 
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For those who have done Problem 9 of the Appendix to Chapter 11, it 
is possible to provide at least one application to differentiability of the 
ideas already developed in this problem set: If f is convex, then f is 
differentiable except at those points where its right-hand derivative f,’ 
is discontinuous; but the function f,’ is increasing, so a convex function 
is automatically differentiable except at a countable set of points. 


Problem 11-70 showed that if every point is a local maximum point for 
a continuous function f, then f is a constant function. Suppose now that 
the hypothesis of continuity is dropped. Prove that f takes on only a 
countable set of values. Hint: For each x choose rational numbers a, 
and b, such that ay < x < by and x is a maximum point for f on 
(ay, b,). Then every value f(x) is the maximum value of f on some 
interval (ay, b,). How many such intervals are there? 


(b) Deduce Problem 11-70(a) as a corollary. 


(c) 


Prove the result of Problem 11-70(b) similarly. 


CHAPTER 


DEFINITION 


INFINITE SEQUENCES 


The idea of an infinite sequence is so natural a concept that it is tempting to 
dispense with a definition altogether. One frequently writes simply * 
sequence 


‘an infinite 


Gy G5. Ga GiwS 5.25 


the three dots indicating that the numbers a; continue to the right “forever.” A 
rigorous definition of an infinite sequence is not hard to formulate, however; the 
unportant point about an infinite sequence is that for each natural number, 7, 
there is a real number a,. ‘Vhis sort of correspondence is precisely what functions 
are meant to formalize. 


An infinite sequence of real numbers is a function whose domain is N. 


From the point of view of this definition, a sequence should be designated by a 
single letter like a, and particular values by 


al); a2) a). 


but the subscript notation 
(OB 3 Clot, (ER 3 ote 


is almost always used instead, and the sequence itself is usually denoted by a symbol 
like {a,}. Thus {7}, {(—1)"}, and {1/n} denote the sequences a, B, and y defined 
by 


An =X, 
Br = ( Tye, 
l 
Yn=t- 
i 


A sequence, like any function, can be graphed (Figure 1) but the graph is usually 


rather unrevealing, since most of the function cannot be fit on the page. 


- {Bn} {Yn} 


e e e 
ra a =a ss Seaonanaanses 


(a) (b) (c) 


FIGURE | 
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-=P=f=6 O fo=fy=fo= 


Y4 2 
a 
0 5 3 Y1 


FIGURE 2 


A more convenient representation of a sequence is obtained by simply labeling 
the points aj, a2, a3, ... on a line (Figure 2). This sort of picture shows where 
the sequence “is going.” The sequence {@,} “goes out to infinity,’ the sequence 
{Bn} “jumps back and forth between —1 and 1,” and the sequence {y,} “converges 
to 0.” Of the three phrases in quotation marks, the last 1s the crucial concept 
associated with sequences, and will be defined precisely (the definition 1s illustrated 
in Figure 3). 


lop ia ; I “ aN4+5 an43 “N41 i I+e a3 a2 ay 


EG URES 


A sequence {a,} converges tol (in symbols lim a, = /) if for every ¢ > 0 there 


is a natural number WN such that, for all natural numbers vn, 


if w S.N, then a; = /\eaies 


In addition to the terminology introduced in this definition, we sometimes say 
that the sequence {a,} approaches / or has the limit J. A sequence {dp} 1s said 
to converge if it converges to / for some /, and to diverge if it does not converge. 


To show that the sequence {y,} converges to 0, it suffices to observe the following, 
If e > O, there is a natural number N such that 1/N < e. Then, if n > N we 
have 


1] 1 | 0 
Sa = sO —— << [Sq 
ul n N i 


The limit 


lim vn +1- vn =0 


will probably seem reasonable after a little reflection (it just says that Yn + I 1s 


practically the same as Vn for large n), but a mathematical proof might not be so 
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obvious. ‘To estimate Yn + 1 — Vn we can use an algebraic trick: 


bas 2 yp ei So rt Gy ea 7) 
Ps any 5 


n+l—n 


7S eee ney 
| 
Dees ye 


It is also possible to estimate Yn + 1 — Vn by applying the Mean Value ‘Theorem 
to the function f(x) = /x on the interval [n,n + 1]. We obtain 


Fee ey 


me Ges of 0) 


l 
a JR for some x in (n,n + 1) 
1 


Di, 


Either of these estimates may be used to prove the above limit; the detailed proof 


<< 


is left to you, as a simple but valuable exercise. 
The limit 
_ 3n2+7n*+1 3 
lim —————— = - 
noo 4n3 —8n+63 4 


should also seem reasonable, because the terms involving n? are the most impor- 
tant when n is large. If you remember the proof of ‘Theorem 7-9 you will be able 
to guess the trick that translates this idea into a proof—dividing top and bottom 
by n° yields 


3+ p 4 
3n3 + Tn? +1 a n ne 
4n3 —8n+63 8 63_ 

Ae ae 

n= ne 


Using this expression, the proof of the above limit is not difficult, especially if one 
uses the following facts: 


If lim a, and lim b, both exist, then 
n—>©o n—> Co 


lim (a, + b,) = lim a, + lim Dp, 
n> Co n— oo n—>O©o 
limi (G,, - b>) = luna, ~ Imdb, : 


n— Co noo noo 


moreover, if lim b, 40, then b, 4 0 for all n greater than some N, and 
n—->& 


limpa,/ 2, = lim a,/ lnm). 
n—> Co n—> CO n—>Cco 
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(If we wanted to be utterly precise, the third statement would have to be even 
more complicated. As it stands, we are considering the limit of the sequence 
{cn} = {an /by}, where the numbers c, might not even be defined for certain n < N. 
This doesn’t really matter—we could define c, any way we liked for such n— 
because the lmit of a sequence is not changed if we change the sequence at a 
finite number of points.) 

Although these facts are very useful, we will not bother stating them as a 
theorem you should have no difficulty proving these results for yourself, because 
the definition of lim a, = / is so similar to previous definitions of limits, especially 


N— © 
lma 7 Cc) =e. 
X00 
The similarity between the definitions of lim a, = / and lm f(x) = / is 
nO X7>0O 
actually closer than mere analogy; it 1s possible to define the first in terms of the 


second. If f is the function whose graph (Figure 4) consists of ne segments joining 


FIGURE 4 
the pomts in the graph of the sequence {a,}, so that 


Cea — a Gy) 9G ,,)(X 71) a Ga Tin = X= Herts Je 


then 


fo @,—* tana only nf @) —w. 
NOX : XO 


Conversely, if f satisfies lim f(x) =/, and we set a, = f(n), then lim a, =1. 
xXxOoO X= OO 
This second observation is frequently very useful. For example, suppose that 
Oar". ”Fhen 


lima =: 
H&S 


To prove this we note that 


; % mibe 
lim a* = lim e* °84 = 0, 
x— SO xX CO 


since loga < 0, so that x loga is a negative and large in absolute value for large x. 


Notice that we actually have 


linea Oe at alee 
ana Oo 


for if a < 0 we can write 


im a” = lm (—1!)"la|"’ =0. 
| oe lim (—1) 
NN DO i> OND 
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THEOREM 1 


PROOF 


The behavior of the logarithm function also shows that if a > 1, then a” be- 
comes arbitrarily large as n becomes large. This assertion is often written 


linea — OO mae 


Nn— Co 


and it is sometimes even said that {a"} approaches oo. We also write equations 
like 


lim —a” = —oo, 
n— OO 


and say that {—a”} approaches —oo. Notice, however, that if a < —1, then in a" 
does not exist, even in this extended sense. 

Despite this connection with a familiar concept, it is more important to visualize 
convergence in terms of the picture of a sequence as pomts on a line (Figure 3). 
There is another connection between limits of functions and limits of sequences 
which 1s related to és picture. This connection is somewhat less obvious, but con- 
siderably more interesting, than the one previously mentioned— instead of defining 
limits of sequences in terms of limits of functions, it is possible to reverse the pro- 
cedure. 


Let f be a function defined in an open interval containing c, except perhaps at c 
itself, with 


hme) — 
Le 
Suppose that {a,,} is a sequence such that 


(1) each a, is in the domain of f, 
(2) seach "ag = c, 


(3) emlinsa — 
nN— OO 


Then the sequence { f(a,,)} satisfies 
lime; (G2 


Conversely, if this is true for every sequence {a,} satisfying the above conditions, 
then! lim f () 8 
aC. 


Suppose first that lim f(x) =/. Then for every ¢ > 0 there is a 6 > O such that, 
SPA e 
fol allo 


if O < |x —c| <6, then |f(x) -1| <e. 


If the sequence {a,} satisfies lim a, = c, then (Figure 3) there is a natural num- 


n—>co 
ber N such that, 
ifn > N, then ja, —e| <6. 


By our choice of 6, this means that 


alae) a l| < &, 


—_——e—_——- —°——#_@ eevee t 
ay a2 a3 a4 a 
EG AWERSE eS 
THEOREM 2 
PROOF 
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showing that 
int ie 


n> OO 


Suppose, conversely, that lim f(a,) =/ for every sequence {a,} with lim a, = 
H— OO i= Ae,9. 


c. If lm f(x) = / were not true, there would be some ¢ > O such that for every 


SA 


6 > O there is an x with 
O< |x-—c| <6 but |f(x)-l>e. 


In particular, for each n there would be a number x, such that 
l 
Oia, —cl<—a— “but yO) — tse 
n 


Now the sequence {x,} clearly converges to c but, since | f(x,) — /| > € for all n, 
the sequence {f(x,)} does not converge to /. This contradicts the hypothesis, so 
lim f(x) =/ must be true. J 


DB ES 


Theorem | provides many examples of convergent sequences. For example, the 
sequences {a,} and {b,} defined by 


| 
4.5m (13 + =) 
| 
: ] 
— ces (sin ( +(—l)". -)] . 
n 


clearly converge to sin(13) and cos(sin(1)), respectively. It is important, however, 
to have some criteria guaranteeing convergence of sequences which are not obvi- 
ously of this sort. ‘There 1s one important criterion which is very easy to prove, but 
which is the basis for all other results. This criterion is stated in terms of concepts 
defined for functions, which therefore apply also to sequences: a sequence {a,} is 
increasing if a,,,; > a, for all n, nondecreasing if a,,; > a, for all n, and 
bounded above if there is a number M such that a, < M for all n; there are sim- 
ilar definitions for sequences which are decreasing, nonincreasing, and bounded 
below. 


If {ay} 1s nondecreasing and bounded above, then {a,} converges (a similar state- 
ment is true if {a,} is nonincreasing and bounded below). 


The set A consisting of all numbers a, 1s, by assumption, bounded above, so A has 


a least wpper-bound @. We clam that: lim ‘a@, =o (Figure:5). In faet, ife > 0, 
ios 


there is some ay satisfying @ — ay < &, since @ is the least upper bound of A. 
Then if n > N we have 


Tipe (Oy spel O02 = (0! SS (00 — (NE << IS 


This proves that lm a, =a. f 
LF iGX 
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The hypothesis that {a,,} 1s bounded above is clearly essential in Theorem 2: if 
{a} 1s not bounded above, then (whether or not {a@,} 1s nondecreasing) {a,} clearly 
diverges. Upon first consideration, it might appear that there should be little 
trouble deciding whether or not a given nondecreasing sequence {a,} 1s bounded 
above, and consequently whether or not {a,} converges. In the next chapter such 
sequences will arise very naturally and, as we shall see, deciding whether or not 
they converge is hardly a trivial matter. Vor the present, you might try to decide 
whether or not the followmeg (obviously increasing) sequence is bounded above: 

ld+35. 14349. 14544944. .... 

Although Theorem 2 treats only a very special class of sequences, it is more 
useful than might appear at first, because it is always possible to extract from an 
arbitrary sequence {a,} another sequence which is either nonincreasing or else 
nondecreasing. ‘To be precise, let us define a subsequence of the sequence {a,} 
to be a sequence of the form 

graph of a 
Gis Giggs 
where the 2; are natural numbers with 


2 and 6 are peak points Ha dD, IB 


i : i a i a ' ~ ‘Then every sequence contains a subsequence which is either nondecreasing or 
5 ; : ; 
nonincreasing. [t is possible to become quite befuddled trying to prove this as- 


sertion, although the proof is very short if you think of the right idea; it is worth 
FIGURE 6 recording as a lemma. 
LEMMA Any sequence {a,} contains a subsequence which is either nondecreasing or non- 


increasing, 


PROOF Call a natural number 2 a “peak point” of the sequence {an} if am < dy, for all 
m > n (Figure 6). 


Case 1. The sequence has infinitely many peak points. (In this case, if ny < ng < 
nye< eee are the peak points, then @,, > Gp, > a,, > ---, SO {@,,} is the desired 
(nonincreasing) subsequence. 

Case 2. The sequence has only finitely many peak points. In this case, let ny be greater 
than all peak pomts. Since 71 is not a peak point, there is some #2 > 71 such that 
Gny > Uy,. Since nz is not a peak pot (it is greater than 21, and hence greater 
than all peak pomts) there is some #3 > 22 such that d,, > dy,. Continuing in this 
way we obtain the desired (nondecreasing) subsequence. § 


If we assume that our origial sequence {a,} 1s bounded, we can pick up an 
extra corollary along the way. 


COROLLARY (THE Every bounded sequence has a convergent subsequence. 
BOLZANO-WEIERSTRASS THEOREM) 


DEFINITION 


THEOREM 3 


PROOF 
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Without some additional assumptions this is as far as we can go: it Is easy to 
construct sequences having many, evenly infinitely many, subsequences converg- 
ing to different numbers (see Problem 3). There is a reasonable assumption to 
add, which yields a necessary and sufficient condition for convergence of any se- 
quence. Although this condition will not be crucial for our work, it does simplify 
many proofs. Moreover, this condition plays a fundamental role im more advanced 
investigations, and for this reason alone it is worth statmg now. 

Ifa sequence converges, so that the individual terms are eventually all close to 
the same number, theu the difference of any two such individual terms should be 
very small. ‘To be precise, if lina a, = 1 for some /, then for any ¢ > O there is 

Hl < 
an N such that la, —/| < ¢/2 forn > N; now if both n > N and m > N, then 


Gare 
(ae Sala) ee |e ce, | B a a= &. 
This final inequality, |a, — @| < €, which eliminates mention of the limit /, can 


be used to formulate a condition (the Cauchy condition) which is clearly necessary 
for convergence of a sequence. 


A sequence {d,} is a Cauchy sequence if for every ¢ > 0 there is a natural 


number N such that, for all m and n, 
ifm,n > N, then la, — am| < e. 


(This condition is usually written lim [a — ad,| = 0.) 
HCO 


The beauty of the Cauchy condition is that it is also sufficient to ensure conver- 
gence of a sequence. After all our preliminary work, there 1s very little left to do 
in order to prove this. 


A sequence {a,} converges if and only if it is a Cauchy sequence. 


We have already shown that {a,} is a Cauchy sequence if it converges. ‘The proof of 
the converse assertion contains only one tricky feature: showing that every Cauchy 
sequence {a} 1s bounded. Ifwe take ¢ = | in the defmition of a Cauchy sequence 
we find that there is some N such that 


lam — an| < | form,a> N. 
In particular, this means that 
lam — Gna1| < | for all m > N. 


Thus {am 1m > N} is bounded; since there are only finitely many other a;’s the 
whole sequence is bounded. 
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The corollary to the Lemma thus implies that some subsequence of {a,} con- 


verges. 


Only one point remains, whose proof will be left to you: if a subsequence of a 
Cauchy sequence converges, then the Cauchy sequence itself converges. ff 


PROBLEMS 


1. Verify each of the following limits. 


(1) 


. n 
lim a 
n>coon+ | 

; n+3 
lim 5 = 
n>oon’? +4 


lim. Vn2 + 1—Vn+1=0. Hint: You should at least be able to prove 


that lim Vn2+1— ) n2= 0. 


n— Co 

LSE. 

lim — = 0. 
n>oo n” 

lim */a = 1, a0) 
n— Co 

lim */n = 1. 
n— Co 

. n 9} 

lim Vn-+tn= 1. 
n—>OCo 

lim Va" + b" = max(a, b), Gib =O: 
n—>Co 

we TOK) . ; ee 
lim = 0, where a(n) is the number of primes which divide n. 
n— Co 


n 
Hint: The fact that each prime is > 2 gives a very simple estimate of 
how small a(n) must be. 


n 


ye 


er ] 

lim ——— = ——. 
n>co nPtl pt ] 
the following limits. 

; n n+ 1 

lim - : 
n>oon + | n 

lim n— J/n+aVn+b. 
n—>0o 

Qn ae (— | Nf 


lim —-W+—_——., 
n>oo 2nt+l (eal yr+l 


(—1)"./n sin(n") 


lim 

n— oo n + l 
ya? — bP 
lim 


n>oo qn + pn ; 


lim ne", \aleall. 
n—> oOo 


(vn) 


(a) 
(b) 


(c) 
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Qn 

hing —. 

noo ni} 
What can be said about the sequence {a,} if it converges and each ay is 
an integer? 
Find all convergent subsequences of the sequence 1, —1, 1, =1, 1, —1, 
.... (There are infinitely many, although there are only two limits which 
such subsequences can have.) 
Find all convergent subsequences of the sequence 1, 2, 1, 2, 3, 1, 2, 
3, 4, 1, 2, 3,475, =... (Bhere? areanfinitely many mits whieh*steh 
subsequences can have.) 
Consider the sequence 


Dee le 2 1 2 
3 3° 3° 4? ae mile) Go Be 


hry— 


For which numbers @ is there a subsequence converging to @? 


Prove that if a subsequence of a Cauchy sequence converges, then so 
does the original Cauchy sequence. 
Prove that any subsequence of a convergent sequence converges. 


Prove thateil 0 <"a = 2eihenmma. </ 2a < 2. 
Prove that the sequence 


SD 5) 22 Dy 
converges. 


Find the liniits Mint: 8Notice thatufelin @y=—/, then lim 24, = V2!, 


n— CO n— Co 
by Theorem 1. 


Let O < a, < b, and define 


(a) 
(b) 


Ont Dy, 
Qn4t = Vanbn. bn = ——- 


-_ 


Prove that the sequences {a,} and {b,} each converge. 
Prove that they have the same limit. 


In Problem 2-16 we saw that any rational approximation k/1 to V2 can be 
replaced by a better approximation (A + 2/)/(A + J). In particular, starting 
with k =/ = 1, we obtain 


(a) 


Prove that this sequence is given recursively by 


| 
ole Ing) = 1+ ———. 
“al at 3 l+ay, 
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10. 


(b) "Proves that’ lim a, = V2. This gives the so-called continued fraction 
n> % 
expansion 
| 
0 aaa 
Base 3 


Hint: Consider separately the subsequences {a2,} and {d2+4}. 
(c) Prove that for any natural numbers a and b, 


oss b 
att+tb=a+ ————— 


b 
a 
A eee 


Identify the function f(x) = lim (him (cosn! mx)7*). (It has been mentioned 
n—-oo k->oo 


many times m this book.) 


Many impressive looking limits can be evaluated easily (especially by the 
person who makes them up), because they are really lower or upper sums mn 
disguise. With this remark as hint, evaluate each of the following. (Warn- 
ing: the list contains one red herring which can be evaluated by clementary 
considerations.) 


Yer Ver4---4 Yor 


Qa) lm 
nO nN 
a MO + Ve +--+ Vem 
(i) = lim. ———————————_ 
NW n 


ij | mige l 
a 7 2n 


Gv) lim 
n> OO 


a + Ply iu +h) 


Hl il 
Sma pe i@+22° 9 ws a) 


(vi) lim 
Nn Oo 


n a Fi n ) 
ne + yo | 1“ py n2 + n2)° 


Although limits like lim Y/n and lim a” can be evaluated using facts about 
n> Ht— 00 


the behavior of the logarithm and exponential functions, this approach. is 
vagucly dissatisfying, because integral roots and powers can be defined with- 
out using the exponential function. Some of the standard “elementary” ar- 
guments for such limits are outlined here; the basic tools are mequalities 
derived from the binomial theorem, notably 


(+h) > 1+nh, for h > 0; 
and, for part (c), 


naa—l)., n(a—l)., : 
(l+h)" > l+nh+ pa > ae for # > 0: 


P=) ~ 


hi; 


1a 


(b) 
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Prove that lim a™ = contra > IF by.sctung a= +e where 0. 
n= © 


Prove that lim @” =0if 0 <a < I. 


n> Oo 

Prove that hm Va =1if a > 1, bysctting Ya = 1+/ and estimating h. 
HOS 

Prove that lim */a = 1 if 0 <a <1. 
n=O 


n 


Prove that hm Yn = 1. 


NCO 


Prove that a convergent sequence 1s always bounded. 
Suppose that lim a, = 0, and that some a, > 0. Prove that the set of 
n> CoO 


all numbers a, actually has a maximum member. 


Prove that 


I 
aay < log(n + 1) — logn < ~ 


If 
ay —— z Rad } — ae Og iH, 


show that the sequence {a,} is decreasing, and that each a, > 0. It 
follows that there is a number 


! 
y = lim (14:42 tog) 
n 


ROD 


‘This number, known as Euler’s number, has proved to be quite refractory; 
it is not even known whether y is rational. 


Suppose that f is increasing on [1, 00). Show that 
fd) +---+ ftrn—1) < / f(xydx < f(2)+---+ fn). 
] 


Now choose f = log and show that 
e oD 


ne (n+ 1)"*! 
<n! < ————__: 
en-l en 
it follows that 
whl i 
lm =-— 
no on e 


This result shows that Vn! is approximately n/e, mm the sense that the 
ratio of these two quantities is close to | for large n. But we cannot 
conclude that a! is close to (1/e)" m this sense; in fact, this is false. An 
esumate for 2! is very desirable, even for concrete computations, because 
n! cannot be calculated easily even with logarithm tables. The standard 
(and difficult) theorem which provides the right information will be found 
in Problem 27-19, 
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14. (a) Show that the tangent line to the graph of f at (x, f(41)) intersects the 
horizontal axis at (x2, 0), where 
f 1) 
fx) 
This intersection point may be regarded as a rough approximation to 
the pomt where the graph of f intersects the horizontal axis. If we now 


lee 


start at x2 and repeat the process to get x3, then use x3 to get x4, etc., 
we have a sequence {x,} defined inductively by 


_ i CG.) 
Tt We ) 


Figure 7 suggests that {x,} will converge to a number c with f(c) = 0; 


Xn+l = Xn 


this is called Nezeton’s method for finding a zero of f. In the remainder 


of this problem we will establish some conditions under which Newton’s 

arene method works (Figures 8 and 9 show two cases where it doesn’t). A few 
facts about convexity may be found useful; see Chapter 11, Appendix. 

(b) Suppose that f,’ f” > 0, and that we choose x; with f(x;) > 0. Show 
thew > x7 ee - > c. 

(c) SLetoe—a% —c. Then 


Lop 
a = 
ff (Ex) 
for some & in (c, x,). Show that 
f (XK) Ce 
(+) Segoe ar oe 
P(e) ake) 
Conclude that 
een Nie 
C—O 
eel lS Om tem 
FIGURE 8 
for some nx in (c, x%), and then that 


pe ee) 
(d) Létan = fee ant f’.on [c¢, s)and fet M = sup jon'{q sil) show 
that Newton’s method works if x, — c < m/M. 
(ce) What is the formula for x,4, when f(x) = x7 — A? 
If we take A = 2 and x; = 1.4 we get 
Y= | 4 
x2 = 1.4142857 
x3 = 1.4142136 
xy = 1.414236, 


which is already correct to 7 decimals! Notice that the number of correct 
decimals at least doubled cach time. ‘Phis is essentially guaranteed by the 
FIGURE 9 inequality (*) when M/m < |. 


DECC OPIS Ie 110) 


15. 


*16, 


17. 


*18. 


HIRE 


20. 


ae 
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Use Newton’s method to estimate the zeros of the following functions. 


(i) f(x) =tanx —cos* x near 0. 
(ii) f(x) =cosx — x? car U. 
(i) ee — Pity ea) On | Gill |e 
iwefiG)— 7° = sn I on [0, 1]. 


Prove that if lim a, = /, then 
N= > CO 


: Girt +--+ a, 
hn 


n>OO n 


= |, 


Hint: This problem is very similar to (in fact, it is actually a special case of) 
Problem 13-40. 
a) Prove that 1 “lima, 7) — a, — | thenslimea,/2 — 2) lim: see the 
n—- Oo : 1 n— Oo 
previous problem. 
(b) Suppose that f is continuous and lim f(x + 1) — f(x) = 1. Prove 
MS) 


that lim f(x)/x =/. Hint: Let a, and b, be the inf and sup of f on 
FiO 
[ee Ue 


Suppose that a, > O for each vn and that lim a,4)/a, = 1. Prove that 
n> CO 


lim </a, = 7. Hint: This requires the same sort of argument that works in 
n> Oo 


Problem 16, except using multiplication instead of addition, together with 
the fact that lim V/a = 1, fora > 0. 


nO 


(a) Suppose that {a,} is a convergent sequence of points all in [0, 1]. Prove 
that lim a, is also in (0, 1]. 
N&O 


(b) Find a convergent sequence {a,} of points all in (0, 1) such that lim a,, 
i n— oo 


is mot im (O- 1). 


Suppose that f is continuous and that the sequence 


AC IM felch Wan Sal f Wile DE Ba. 


converges to /. Prove that / is a “fixed point” for f,1.e., f(@) =/. Hint: Two 
special cases have occurred already. 


(a) Suppose that f is continuous on [0,1] and that 0 < f(x) < 1 forall.x in 
{O. 1]. Problem 7-11 shows that f has a fixed pomt (in the terminology 
of Problem 20). If f is increasing, a much stronger statement can be made: 
kor any x in [0, 1], the sequence 


Me fF (o> ECE GS), 2a 


has a limit (which is necessarily a fixed point, by Problem 20). Prove this 
assertion, by examining the behavior of the sequence for f(x) > x and 
f(x) < x, or by looking at Figure 10. A diagram of this sort is used 
in Littlewood’s Mathematician’s Mhscellany to preach the value of drawing 
pictures: “For the professional the only proof needed is [this Figure].” 
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*(b) Suppose that f and g are two continuous functions on [0, 1], with 0 < 
f(x) <1 and 0 < g(x):< 1 for all x m [0,1], which satisfy fog = 
go f. Suppose, moreover, that f is increasing. Show that f and g have 
a common fixed point; in other words, there is a number / such that 
f() =1 = g(d). Hint: Begin by choosing a fixed point for g. 


For a long time mathematicians amused themselves by asking whether the 
conclusion of part (b) holds without the assumption that f is increasing, but 
two independent announcements in the /Voleces of the American Mathemati- 
cal Society, Volume 14, Number 2 give counterexamples, so it was probably 
a pretty silly problem all along. 


The trick 11 Problem 20 is really much more valuable than Problem 20 might 


suggest, and some of the most important “hxed poimt theorems” depend upon 
looking at sequences of the form x, f(x), f(f(x)), .... A special, but representa- 
tive, case of one such theorem is treated in Problem 23 (for which the next problem 
Is preparation). 


ape 


2 3 


ge, 


20% 


(a) Use Problem 2-5 to show that if ¢ 1, then 


tt | 


cn ae cnt! Bey he oo 
—C¢ 


(b) Suppose that |c| < |. Prove that 


hm cc! eee = 0. 


nt, A> OO 


(Cc) Supposesthat {x,} is a sequence witl) |, —%,41| = e', where 0 <c <9R 
Prove that {x,} is a Cauchy sequence. 


Suppose that f is a function on R such that 

() |f(x) — fiy)| < elx — yl, for all x and y, 
where c < I. (Such a function ts called a contraction.) 
(a) Prove that f is continuous. 


(b) Prove that f has at most one fixed pomt. 
(c) By considering the sequence 


Rs Sf (Xho fT (oy Gl eee 


for any x, prove that f does have a fixed point. (This result, 1 a more 
general setting, 1s know1 as the “contraction lemma.”) 


(a) Prove that if f is differentiable and {f"| < 1, then f has at most one 
fixed poimt. 

(b) Prove that if |f’@)| < c <1 for all x, then f has a fixed poimt. 

(c) Gtve au example to show that the hypothesis | f’(x)| < 1 1s not sufficient 
to ensure that f has a fixed pomit. 

‘Vhis problem is a sort of converse to the previous problem. Let by be a 


Sequénee defined by by = a,'b,4) = f(b,). Prove that if b = lut) db, exists 
itkacae, 9) 


26. 


Jae 
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and f’ is continuous at b, then |f’(b)| < | (provided that we don’t already 
have b; =b for somes)... lint? If |fi(b) |p > Wgathiens| (40g) I> aleforall> an 
an interval around b, and 6, will be in this interval for large enough n. Now 
consider f on the interval [b, by]. 


This problem investigates for which a > 0 the symbol 


a 


b, 


makes sense. In other words, if we define b} = a, Dai) = a’, when does 


b = lim by, exist? Note that if b exists, then a? = b by Problem 20. 
NCO 

(a) If b exists, then a can be written in the form y!/” for some y. Describe 
the graph of g(vy) = y!”” and conclude that 0 <a < e!/*, 

(b) Suppose that | <a < e!/¢. Show that {b,} is increasing and also by, < e. 
This proves that b exists (and also that b < e). 


The analysis for a < | is more difficult. 
(c) Usmg Problem 25, show that if b exists, then e~! <b <e. Then show 
thst 6° Seen 
From now on we will suppose that e~* <a < 1. 


(d) Show that the function 


es 


Fay — 
log x 
is decreasing on the interval (0, 1). 
(ce) Let b be the unique number such that a? = b. Show that a < b < 1. 
Using part (e), show that if 0 <x < b, then x <a” <b. Conclude that 


f= lim a>,.78exists ameliname =a. 
N— 0 


(f) Using part (e) agam, show that / = b. 
(g) Finally, show that lim a@2,42 = b, so that hm b, = b. 
a Cx N— Oo 


Let {x,} be a sequence which is bounded, and let 


Ma = sup{Xn, ta 8 Dae 


(a) Prove that the sequence {y,} converges. The limit lim y,, 1s denoted by 
- n—-> GO 


lim x, or lim supx,, and called the limit superior, or upper limit, 
n> Oo noo 


of the sequence {x,}. 


(b) Find hm x, for each of the folowing: 
n> 
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28. 


2) 


Gi ee ty ee 


(veer 7. 


(c) Define lim x, (or lim inf x,) and prove that 
noo ie Be 


lit x, <= tino. 
n—-00 if or AO.) 


(d) Prove that hm x, exists if and only if lm x, = lim x, and that in this 
n—> OO I 2G. Si pe, 
n> oo 


Gise ities, — bin x7 —liniy,. 
ht © n=O n—>0o 
(ec) Recall the definition, in Problem 8-18, of lim A for a bounded set A. 


Prove that if the numbers x, are distinct, then lm x, = ltm A, where 
[Pes 
A = {jeer IN}. 


In the Appendix to Chapter 8 we defined uniform continuity of a function 
on an interval. If f (+) is defined only for rational x, this concept still makes 
sense: we say that f is uniformly contiuous on an interval if for every € > O 
there is some 6 > 0 such that, if x and y are rational numbers in the interval 
and |x — y| < 6, then |f(x) — f(y)| <e. 


(a) Let x be any (rational or irrational) point in the interval, and let {x,} be 


a sequence of rational points in the interval such that lim x, =x. Show 
i— oO 


that the sequence { f(x,)} converges. 
(b) Prove that the limit of the sequence { f(x,,)} doesn’t depend on the choice 
of the sequence {x,}. 


We will denote this limit by f(x), so that f is an extension of f to the 
whole interval. 


(c) Prove that the extended function f is uniformly continuous on the mter- 
val. 


Let a > O, and for rational x let f(x) = a*, as defined in the usual elementary 
algebraic way. ‘This problem shows directly that f can be extended to a 
continuous function f on the whole line. Problem 28 provides the necessary 
machinery. 


(a) For rational.« <.y, show that-a* < @ for a > | and a* > a? for a< I. 

(b) Using Problem 10, show that for any ¢ > 0 we have |a* — 1| < e for 
rational numbers x close enough to 0. 

(c) Using the equation a* — a? = a*(a*~* — 1), prove that on any closed 
interval f is uniformly continuous, in the sense of Problem 28. 

(d) Show that the extended function f of Probleni 28 is increasing for a > | 
and decreasing for a < | and satisfies f(x +) = fQ) SO). 


*30. 


3 


BES 2. 
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The Bolzano-Weierstrass Theorem is usually stated, and also proved, quite 
differently than in the text —the classical statement uses the notion of limit 
points. A point x is a limit point of the set A if for every ¢ > O there is a 
point a in A with |x —a| <e but x 4a. 


(a) Find all limit pomts of the following sets. 


(1) [on in NI. 


Hl 


LS al 
(il) | +—:nandm in N}. 


iH HT 


(111) {09 1 + | [Ain Nj. 
n 


Gv) Z. 
) Q. 
(b) Prove that x is a limit point of A if and only if for every € > O there are 
infinitely many pomts a of A satisfying |x — al < €. 
(c) Prove that lim A is the largest limit point of A, and lim A the smallest. 


The usual form of the Bolzano-Weierstrass Theorem states that if A is 
an infinite set of numbers contained in a closed interval [a, b], then some 
point of [a, b] is a limit point of A. Prove this in two ways: 


(d) Using the form already proved in the text. Hint: Since A is infinite, there 
are distinct numbers x1, x2, x3, ... In A. 

(e) Using the Nested Intervals Theorem. Hint: If [a,b] is divided into two 
intervals, at least one must contain infinitely many points of A. 


(a) Use the Bolzano-Weicrstrass Theorem to prove that if f 1s continuous 
on [a, b], then f is bounded above on [a,b]. Hint: If f is not bounded 
above, then there are points x, in [a,b] with f(x,) >. 

(b) Also use the Bolzano-Weterstrass ‘Theorem to prove that if f is contin- 
uous on [a,b], then f is uniformly continuous on [a, b] (see Chapter 8, 
Appendix). 


(a) Let {a,} be the sequence 


Suppose that 0 < a < b< 1. Let N(n: a,b) be the number of integers 
5 6 7 5 9) - 
j <ansuch that a; ism (a, b). (Thus N(2; ¥ a) = 2, and NG; 7 2) = 3,) 


Prove that 


N(n: a,b) 
lim. —— = b—-a. 
n> oo n 


(b) A sequence {a,} of numbers in [0, 1] is called uniformly distributed 
1 OA at 
N(n: a,b) 


lin) ————._ = b — a 
n> oo 7 
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(b) 


for all a and b with 0 < a < b < 1. Prove that if s is a step function 
defined on [0, 1], and {a,} 1s uniformly distributed in [0, 1], then 


[ ; S\(Gi) <P sa) 
s= im — ————__.. 
0) noo n 
Prove that if {a,} 1s uniformly distributed in [0,1] and f is integrable 
on [0, 1], then 
Y ae PG) EG) 
f= ln — —. 
0 n—>©o n 
Let f be a function defined on [0, 1] such that lim f(y) exists for all a 
ya 


in [0, 1]. For any ¢ > O prove that there are only finitely many points a 
in [0, 1] with | lim f(y) — f(@)| > e. Hint: Show that the set of such 
ya 
points cannot have a limit point x, by showing that lm f(y) could not 
yx 

exist. 

Prove that, in the termmology of Problem 21-5, the set of points where 
f 1s discontinuous is countable. ‘This finally answers the question of 
Problem 6-17: If f has only removable discontinuities, then f is contin- 


uous except at a countable set of pomts, and in particular, f cannot be 
discontinuous everywhere. 


Cher ER 


INFINITE SERIES 


Infinite sequences were introduced in the previous chapter with the specific inten- 
tion of considering their “sums” 


(0h) ap GD) Se GB ap 226 


in this chapter. This is not an entirely straightforward matter, for the sum of 
infinitely many numbers is as yet completely undefined. What can be defined are 
the “partial sums” 


Sp =A, +--+ + Gn, 


and the infinite sum must presumably be defined in terms of these partial sums. 
Fortunately, the mechanism for formulating this definition has already been devel- 
oped in the previous chapter. If there 1s to be any hope of computing the infinite 
sum aj +a2+a3+---, the partial sums s, should represent closer and closer ap- 
proximations as wis chosen larger and larger. ‘This last asseruon amounts to little 
more than a sloppy definition of limits: the “infinite sum” ay +a2+a3+--- ought 
to be lim s,. ‘his approach will necessarily leave the “sum” of many sequences 
N—~> OO 

undefined, since the sequence {s,} may easily fail to have a limit. For example, the 
sequence 


Lo aihoL. =I), 
with a, = (—1)"*! yields the new sequence 


Sa — le 

53 =a; +a =), 
Ss=a,tata=l, 
sgs=artatagtay, =O, 


for which lim s, does not exist. Although there happen to be some clever ex- 
pi 22.6 


tensions of the definition suggested here (see Problems 12 and 24-20) it seems 
unavoidable that some sequences will have no sum. For this reason, an acceptable 
definition of the sum of a sequence should contain, as an essential component, 
ternunology which distinguishes sequences for which sums can be defined from 
less fortunate sequences. 
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DEFINITION 


The sequence {a,} 1s summiable if the sequence {s,} converges, where 


Sn = Q, F-** +a 


In this case, lim 5s, 1s denoted by 
n—> OO 
Oo 


Gy) (omdless formally @j4- 4.4, @3 7: 


n=] 


and 1s called the sum of the sequence {a,}. 


The terminology mtroduced in this definition is usually replaced by less precise 


expressions; indeed the title of this chapter 1s derived from such everyday language. 
lo, 2) 


An infinite sum ) dy 1s usually called an infinite series, the word “series” emphasiz- 


n=] 
mg the connection with the mfinite sequence {a,}. ‘Vhe statement that {a,} 1s, or 
CO 


is not, summable is conventionally replaced by the statement that the series ) Ay 


n=l 
does, or does not, converge. ‘This terminology 1s somewhat peculiar, because at 
oO 


best the symbol ) dy, denotes a number (so it can’t “converge”), and it doesn’t de- 


n=] 
note anything at all unless {a,} 1s summable. Nevertheless, this informal language 


is convenient, standard, and unlikely to yield to attacks on logical grounds. 


Certam elementary arithmetical operations on infinite series are direct conse- 
quences of the definition. It is a simple exercise to show that if {a,} and {b,} are 
summable, then 


one O° one 
eG, + b,) = Ayn + E Dr. 
n=] n=} n=l 

fone foxe 

3 CoA—<«: i Gs 

n=l n=l 


As yet these equations are not very imteresting, since we have no examples of 
summable sequences (except for the trivial examples m which the terms are even- 
tually all 0). Before we actually exhibit a summable sequence, some general con- 
ditions for summability will be recorded. 


There is one necessary and sufficient condition for summability which can be 
stated immediately. ‘The sequence {a,,} is summiable if and only if the sequence {5,} 
converges, which happens, according to ‘Theorem 22-3, ifand only if lim_ sy, — 

mind 
Sn = 0; this condition can be rephrased im terms of the original sequence as follows. 


THE CAUCHY CRITERION 


THE VANISHING CONDITION 
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‘The sequence {a,} is summable if and only if 


lim aAn+] + peek + Am = 0. 
le, 2) 


AM a 


Although the Cauchy criterion is of theoretical importance, it is not very useful 
for deciding the summability of any particular sequence. However, one simple 
consequence of the Gauchy criterion provides a necessary condition for summability 
which is too important not to be mentioned explicitly. 


If {a,} is summable, then 


lima, =x(). 
N—> CO 


This condition follows from the Cauchy criterion by taking m =n + 1; it can also 


be proved directly as follows. If lim s, = /, then 
| $—— 216, @) 


lige ere eam Bn yy te le biog a bn 
n— Oo nO n— Oo Leo 


J—-1=0. 


Unfortunately, this condition is far from sufficient. For example, lim |/n = 0, 
nN Oo 


but the sequence {1/n} is not summable; in fact, the following grouping of the 
numbers |/n shows that the sequence {s,} is not bounded: 


1 l l l ] l l ! l 
me a eldegig Om easy CRE Ie 
es 
] 


i 
25) Zao 25) 
(2 terms, (4 terms, (8 terms, 
each > 1) each > z) each >t) 


The method of proof used in this example, a clever trick which one might never 
see, reveals the need for some more standard methods for attacking these problems. 


These methods shall be developed soon (one of them will give an alternate proof 
[e,@) 


that ) 1/n does not converge) but it will be necessary to first procure a few 


nl 
examples of convergent series. 
35 


The most important of all infinite series are the “geometric series 


oO 

Nn 2 3 
Yor Ss lap tr pe. 
n= 


Only the cases |r| < I are interesting, since the individual terms do not approach 0 
if |r| => 1. These series can be managed because the partial sums 


Sy = l4trt+-:--4+r" 
can be evaluated in simple terms. The two equations 


Sn = l S aeiay el aes 
Sy) = Par re fees py pit 
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THE BOUNDEDNESS CRITERION 


THEOREM 1 
(THE COMPARISON TEST) 


lead to 
(1-year 
or 
= prt 
i Bee 
(division by | — r is valid since we are not considering the case r = 1). Now 
lim r” = 0, since |r| < 1. It follows that 
n> CO 
O° n+l 
J wr l 
Dr = ln ——— = —_, alee 
noo | —= iP | =F 
n=0 
In particular, 
oO ] n ie.) ] n ] 
Dale be() —'= gt 
n=] n=0 D 
that 1s, 
iis ee en 
2 4 8 16 ous 


an infinite sum which can always be remembered from the picture mn Figure 1. 


PG URES 


Special as they are, geometric series are standard examples from which nportant 
tests for summability will be derived. 

For a while we shall consider only sequences {a,} with each a, > 0; such 
sequences are called nonnegative. If {a,,} is a nonnegative sequence, then the se- 
quence {s,} 1s clearly nondecreasing. This remark, combined with ‘Theorem 22-2, 


provides a simple-minded test for summability: 


A nonnegative sequence {a,} is summable if and only if the set of partial 
sums Sy, is bounded. 


By itself, this criterion is not very helpful deciding whether or not the set of 
all s, is bounded is just what we are unable to do. On the other hand, if some 
convergent series are already available for comparison, this criterion can be used 
to obtain a result whose simplicity belies its importance (it is the basis for almost 
all other tests). 


Suppose that 


= @r=b) for all n. 


PROOF 


THEOREM 2 
(THE LIMIT COMPARISON TEST) 
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fo @) [o @) 
Then if ) b, converges, so does ) Gas 


n=1 n=1 


If 
Sn = A| amie On 
tn = bj sberlin 
then 
O=<s, =F for all n. 
(oe) 


Now {t,} 1s bounded, since ) b, converges. Therefore {s,} is bounded; conse- 


n—l 
oO 


quently, by the boundedness criterion I an converges. ff 


n— 


Quite frequently the comparison test can be used to analyze very complicated 
looking series in which most of the complication is irrelevant. For example, 


(oe) 


ys 2+ sin? (n +1) 
27 + n2 


n=1 
CONVETrgES because 
2+sine(n+1) 3 
on ee a es 
= Qn o's n2 Qn ? 


and 


is a convergent (geometric) series. 
Similarly, we would expect the series 
[e,2) 
l 


de 


n=! 


27>—1+ sin? n3 


to converge, since the nth term of the series is practically 1/2” for large n, and we 
would expect the series 


to diverge, since (n + 1)/(n? + 1) is practically 1/n for large n. These facts can 
be derived immediately from the following theorem, another kind of “comparison 
test.” 


[o.) 0° 

li-a,..p, => 0. and lma,/b,= ¢ 40; then ) ad, converges if and only if ) b, 
n— Oo 

converges. n=1 n=1 
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PROOF 


THEOREM 3 (THE RATIO TEST) 


PROOF 


(e.9) 
Suppose SB converges. Since lim d;/b, = c, there is some N such that 
ay n—>0Oo 
(eel bre forn > N. 
(o@) 
But the sequence ae certainly converges. ‘Then Theorem | shows that 


ni 
(ee) foe) 


) ad, converges, and this imphes convergence of the whole series ) a,, which 


n=N n= 
has only fimitely many additional terms. 


The converse follows immediately, since we also have lim b,/a, = 1/c 4 0. J 
n— oo 


The comparison test yields other important tests when we use previously an- 
lo. @) 


alyzed series as catalysts. Choosing the geometric series ) r ) ihe convergent 
n=0 


series par excellence, we obtain the most important of all tests for summability. 
Let a, > 0 for all 1, and suppose that 


‘ an+] 
lnm 


n—>CO Ay 


[o @) 
‘Then yan converses f r <> On the other hand, if 7 > Isihen tie terms a, 


n=1 
foe) 


are unbounded, so ) a, diverges. (Notice that it is therefore essential to compute 


n=l 
lim 4@)41/a, and not lim a,/aj+1!) 
n—©o n—cCo 


Suppose first that r < 1. Choose any number s with r < s < 1. The hypothesis 


An+] 


lim =e || 
N>0O Gy 
implies that there is some N such that 
a 
eae! < forn > N. 
‘This can be written 
Ge se = SGh lor =. 


‘Thus 
Qn41 = San, 


3 
An+2 S Say41 SS°an, 


AN+k S ey 
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[o, 2) 
Since ) ays* = av) s* converges, the comparison test shows that 
k=0 k=0 


[o,2) 
converges. ‘This implies the convergence of the whole series ) Gn 
n=1 


The case r > 1 is even easier. If 1 < s <r, then there is a number N such that 


an+) 


5 forn> N, 
an 


which means that 


an+x > ans* ei nO lees, 


so that the terms are unbounded. § 


As a simple application of the ratio test, consider the series SS l/n!. Letting 


n=1 
A, = 1/n! we obtain 


l 
Grd Wa WE (n+)! _ Wh ae ee 
An l  (n +1)! n+1 
n! 
Thus 
lim oral a 0, 


n>Co Ay 


[o @) 
which shows that the series ) 1/n! converges. If we consider instead the series 


n=1 
(ove) 


) r”/n!, where r is some fixed positive number, then 


n=1 


prt 
‘ n-+ 1)! . 
lim Cite = hina = 
n—oo re n>oo nl + 
n! 
[o. @) 
so ) r"/n! converges. It follows that 
n=1 
n 
lim == Q, 


noo n! 
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THEOREM 4 (THE INTEGRAL TEST) 


PROOF 


a result already proved in Chapter 16 (the proof given there was based on the same 


ideas as those used in the ratio test). Iinally, if we consider the series ) nr” we 


n=l 
have 
(n+ drt! : n+] 
lma ——— = lim r- =r, 
n> nr” n> 00 MN 
ie) 
since lint@re- ym —"I This provestthat af Oe < Iihen ) nr” converges, 
N— CO 
nl 


and consequently 


lim ar” = 0. 
be 20.8) 


(This result clearly holds for —1 <r < 0, also.) It is a useful exercise to provide a 

direct proof of this limit, without using the ratio test as an intermediary. 
Although the ratio test will be of the utmost theoretical importance, as a practical 

tool it will frequently be found disappomting. One drawback of the ratio test is 


the fact that lim a,41/a, may be quite difficult to determine, and may not even 
ibe, ©) 


exist. A more serious deficiency, which appears with maddening regularity, is the 
fact that the limit might equal 1. ‘The case lim a,41/ad;, = 1 1s precisely the one 


nO 


which is inconclusive: {a,} might not be summable (for example, if a, = 1/7), 
CO 


. . . ~ . < 
but then again it might be. In fact, our very next test will show that a I /n)- 


a 
converges, even though 


This test provides a quite different method for determining convergence or diver- 
gence of infinite series—like the ratio test, it is an immeciiate consequence of the 
comparison test, but the series chosen for comparison is quite novel. 


Suppose that f is positive and decreasing on [1], 00), and that f(#2) = a, for all n. 
oO 


Then ) dy converges if and only if the limit 


OO A 
/ , =A i, yf 
1 A—>oo 1 


i=l 


CXIStS. 


‘The existence of iin a f is equivalent to convergence of the series 


[rokfenel fl 


FIGURE 2 
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Now, since f 1s decreasing we have (Figure 2) 


n+l 
fine) < | 1 AG 


n 
OX 
The first half of this double inequality shows that the series ye Gn4) may be com- 


n=" : 
oe n+l Be 


OW 
pared to the series ) f, proving that ) ay41 (and hence ) dn) converges 


A 
if jim eXIsts. 
A> 0o ] 
Ov n+l 


The second half of the inequality shows that the series > f may be com- 
n 


n=l *" n=) ill 


ipl 
aw 


A oO 
pared to the series ) dn, proving that lm / f must exist if ) a, converges. ff 
1 


A>Xx 
n=1 n=1 


Only one example using the integral test will be given here, but it settles the 


question of convergence for infinitely many series at once. If p > O, the conver- 
XY 


gence of ) 1/n? is equivalent, by the integral test, to the existence of 


p= 
Le 
— dx 
ip ee 
Now 
| | l Z| 
— D} 
/ a (p—1) Apo! p-| f 
We log A, aN 
A oo 
‘This shows that lim / | /X ahxsexists at pp =p but not j=l) 1 ins a lye 
A> ov 1 
n=1 
@ ‘S) 
converges precisely for p > 1. In particular, Ne 1/n diverges. 
i 


The tests considered so far apply only to nonnegative sequences, but nonpositive 
sequences may be handled in precisely the same way. In fact, since 


Sine) 


| n=] 
all considerations about nonpositive sequences can be reduced to questions involv- 
ing nonnegative sequences. Sequences which contain both positive and negative 
terms are quite another story. 
Coo 
If dal is a sequence with both positive and negative terms, one cau con- 


pl 
x 


sider instead the sequeuce ) lan 


, all of whose terms are nonnegative. Cheerfully 


n=l 
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DEFINITION 


THEOREM 5 


PROOF 


ignoring the possibility that we may have thrown away all the interesting informa- 
tion about the original sequence, we proceed to culogize those sequences which 
are converted by this procedure into convergent sequences. 


ee 0° 


‘The series ) a, 1s absolutely convergent if the series ) |a,| is convergent. 


n=| n=] 
(In more formal language, the sequence {a,} 1s absolutely summable if the 


sequence {|a,|} 1s summable.) 


Although we have no right to expect this definition to be of any interest, it turns 
out to be exceedingly important. ‘The following theorem shows that the definition 
is at least not entirely useless. 


Every absolutely convergent series is convergent. Moreover, a series is absolutely 
convergent if and only if the series formed from its positive terms and the series 
formed from its negative terms both converge. 


@.@) 
If ) la,| converges, then, by the Cauchy criterion, 


ai 


lim |an41| +-+-+ lam| = 0. 


MN OO 
Since 
(ane Se 8 ae aAn| ES ldnail mea oe (ae ls 


it follows that 
lim @p4j +++: + am =O, 


Mm ,N—> CO 
ie @) 
which shows that ) Ay converges. 


n=! 
To prove the second part of the theorem, let 


rr Gis gla, 0 
an, = 


Om ita 0: 
| amelie) 


CC — 


0, Bil ax Se0- 


30 th: + is the series formed fr he itive terms of and = 

so that dad, 1S the series tormed trom the positive terms o Ay, ANC ay 
n=] n=l fi 

is the series formed from the negative terms. 


If ) a,* and ) a, both converge, then 


n=! n=] 
5 S 4 » + . - 

lan | = [an =a; ) = ano Uy 

i= n 


n=| n=] n=l 


THEOREM 6 (LEIBNIZ’S THEOREM) 


PROOF 
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[e,2) 
also converges, so ) a, converges absolutely. 


n=1 
oo (ove) 


On the other hand, if ) la,| converges, then, as we have just shown, ) An 


n=1 n=1 
also converges. Therefore 


Se aay = 3(La Ss yy in) 
n=1 


n=1| n=1 


and i. | 
nasil = 3(Le 7 2S in!) 


n=l n=1 1 


both converge. J 


It follows from Theorem 5 that every convergent series with positive terms can 
be used to obtain infinitely many other convergent series, simply by putting in 
minus signs at random. Not every convergent series can be obtained in this way, 
however—there are series which are convergent but not absolutely convergent 
(such series are called conditionally convergent). In order to prove this state- 
ment we need a test for convergence which applies specifically to series with positive 
and negative terms. 


Suppose that 


ss 
IV 
Q 
i) 
IV 
Q 
ww 
IV 
V 
> 


and that 


limita, 10) 
n—?>co 


Then the series 
_4yyntl ral a: Pa ak Foe 
Gl) Gp = 1 — G7 G3)\— 44-45 —- 
converges. 


Figure 3 illustrates relationships between the partial sums which we will establish: 


(so = 84 Sts6 = -°-5 

Qi = $3 issn 8 

(3) se < 8 if k is even and / is odd. 
SSS ii a ae 

AY) S4 S6 Sg S1Q 812 S11] SoS7 S85 $3. «SY 


FIGURE 3 
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To prove the first two inequalities, observe that 


(1) S2n42 = S2n + Gantt — G2n42 

= S2n; since A2n+1 2 A2n42 
(2) S2n4+3 = S2n41 — 42n42 + A2n43 

S S2n+1> SINCE A2n42 = A2n43- 


‘To prove the third inequality, notice first that 


S2n = S2n—1 — 42n 


SS ee since a2, > 0. 


This proves only a special case of (3), but in conjunction with (1) and (2) the general 
case 1s easy: if k is even and / is odd, choose n such that 


2n=>k and 2n— lei: 
then 
Sk S S2n S S2n-1 < SI, 
which proves (3). 
Now, the sequence {s2,,} converges, because it is nondecreasing and is bounded 
above (by s; for any odd /). Let 
@ = supison) — Limes9,. 
n—>OCo 
Similarly, let 


PB =antiso, == linmiesy eae 
n— Co 


It follows from (3) that a < f; since 


So Soy = Go, cane) ima; — 0 


noo 


it is actually the case that a = B. This proves that a = 6 = lim sy. 
[oe) 


n=» 
The standard example derived from ‘Theorem 6 1s the series 
tie gal 
listo h grease oye 


ss 
which is convergent, but not absolutely convergent (since ) 1/n does not con- 


n=| 
verge). If the sum of this series is denoted by x, the following manipulations lead 


to quite a paradoxical result: 


x= 


=(1-$)-4+@G-)-3+G@G-p-pt+G-W-#Bt 


THEOREM 7 


PROOF 
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so x = x/2, implying that x = 0. On the other hand, it is easy to see that x 4 0: 
the partial sum s2 equals 4, and the proof of Leibniz’s Theorem shows that x > 52. 


This contradiction depends on a step which takes for granted that operations 
valid for finite sums necessarily have analogues for infinite sums. It is true that the 
sequence 


= 2. Nee! 
{an} = 1, Dis G@ Ws 8? 9: i? 2 12. 
In fact, {b,} is a rearrangement of {a,} in the following precise sense: each 
by = afin) Where f is a certain function which “permutes” the natural numbers, 
that is, every natural number m is f (1) for precisely one n. In our example 


i neo) = sue + ly (theaters el, i. rare go into the Ist, 4th, 7th, 
places), 

f (Am) eT (the terms —i. —%. or - go mio the 3rd, Gt pth, 
4. Dlacesls 

f(4m +2) =3m+2 = (the terms —5, —i, —+- -.. 0 into th® 2nd; Sel, Sth: 
+> Dlagesr 


Nevertheless, there 1s no reason to assume that ) b, should equal ) An. these 


=| n= 
sums are, by definition, lim bj +---+b, and lim a; +--++ ay, so the particular 
N— 0o N>OO 
[o,@) 
order of the terms can quite conceivably matter. ‘The series ) (—1)"" /rgiswnot 
=| 


special in this regard; indeed, its behavior is typical of series which are not ab- 
solutely convergent—the following result (really more of a grand counterexample 
than a theorem) shows how bad conditionally convergent series are. 


co 


Ihe ) dn converges, but does not converge absolutely, then for any number @ there 


j= lI 
OO 
is a rearrangement {b,} of {a,} such that ) be — ae 
n=1 
co oC 


Get ) Pn denote the series formed from the positive terms of {a,} and let ) Bi 


=| i 
denote the series of negative terms. It follows from Theorem 5 that at least one of 
these series does not converge. As a matter of fact, both must fail to converge, for 


if one had bounded partial sums, and the other had unbounded partial sums, then 
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[e,2) 
the original series ) a, would also have unbounded partial sums, contradicting 


n=1 
the assumption that it converges. 


Now let @ be any number. Assume, for simplicity, that a > 0 (the proof for 
le 6) 
a < 0 will be a simple modification). Since the series SP Pn 1S not convergent, 


n=1 
there is a number WN such that 


N 
SD: S3(0%5 


n=1 


We will choose Nj to be the smallest N with this property. This means that 


but (2) we >a. 


Then if 
Ni 
S| = ore 
n=1| 
we have 
S| Ores PN,- 
Pn, 
<a 
Neat Se SSS 
0 Pit-:-+ Pn,-1 a Pi +-:-+ pn,-1 + Pn, 
FIGURE 4 


This relation, which is clear from Figure 4, follows immediately from equation (1): 


N,-1 
S| — a < Sy ~ yn Pn = PN: 


n=1 


To the sum S; we now add on just enough negative terms to obtain a new sum 7] 
which is less than @. In other words, we choose the smallest integer M, for which 


As before, we have 
CO] T= Gi. 


We now continue this procedure indefinitely, obtaining sums alternately larger 
and smaller than @, each time choosing the smallest Ny or M,; possible. The 
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sequence 


Piste DN, Gls-- 5 Gis PN Ie ae Noe 


is a rearrangement of {a,}. The partial sums of this rearrangement increase to Sj, 
then decrease to 7), then increase to Sz, then decrease to 72, etc. To complete the 
proof we simply note that |S;—a@| and |7;—a@| are less than or equal to py, or —qgm,, 


respectively, and that these terms, being members of the original sequence {ap}, 
[e.@) 


must decrease to 0, since ) a, converges. ff 


Ill 


‘Together with Theorem 7, the next theorem establishes conclusively the distinc- 
tion between conditionally convergent and absolutely convergent series. 


if a, converges absolutely, and {b,} is any rearrangement of {a,}, then ) nye 


n=] n=l 
also converges (absolutely), and 


fone) oo 
) an = ; By, 


n= n=1 


Let us denote the partial sums of {a,} by s,, and the partial sums of {b,} by th. 
OO 


Suppose that ¢ > 0. Since ) a, converges, there is some N such that 


n=] 


[o,@) 


) an — SN 


n=1 


EE 


[e @) 
Moreover, since ) |a,| converges, we can also choose N so that 


n=1 


_ 
Yo lanl — (laqi| +++ + lawl) <e, 


n=] 
Ie. So that 


lanail + law+al + laya3|+--- <. 


Now choose M so large that each of a},...,ay appear among bj,....by. Then 
whenever m > M, the difference t, — sy is the sum of certain a;, where a,,.... an 
are definitely excluded. Consequently, 


lim — Sv| S lan+1| + lan42l + lana3|+--- . 
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Thus, if m > M, then 


fore) foe) 
) an tn| = | ) Qn — SN — (in ae Sn) 
n=1 n=] 
fore) 
< ) An — SN ate lem —s S| 
n=1 
<< (3 a> tS, 
o°e) foe) 


Since this is true for every ¢ > O, the series ) b, converges to ) Gre 


n=| n=1 
(ove) 


‘To show that Dae, converges absolutely, note that {|b,|} is a rearrangement 


n=1 


(oe) (oe) 

of { |an| }; since Ss |a,| converges absolutely, Ss |b,| converges by the first part of 
n=1 n=1 

the theorem. J 


Absolute convergence is also important when we want to multiply two infinite 
series. Unlike the situation for addition, where we have the simple formula 


CO 


So, SE esa 


n=1 n=1 n=1 


there isn’t quite so obvious a candidate for the product 


(So) (do —I(Gipai Goa a) (Oporto) 


n= n=1 


It would seem that we ought to sum all the products a;b;. ‘The trouble is that these 
form a two-dimensional array, rather than a sequence: 


a,b ay,b2 a\b3 
arb arb? arb 
azb a3b2 a3b3 


Nevertheless, all the elements of this array can be arranged in a sequence. ‘The 
) y 

picture below shows one way of doing this, and of course, there are (infinitely) 
many other ways. 


a,b a\b2 a, b3 
arb, arb arb; 


a3b a3bp a3b3 
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Suppose that {c,} 1s some sequence of this sort, containing each product a,b; 
just once. ‘Then we might naively est to have 


y C a = SS An * y up 
n=! n=1 


n=] 
But this zsv’t true (see Problem 10), nor is this really so surprising, since we've said 
nothing about the specific arrangement of the terms. The next theorem shows 
that the result does hold when the arrangement of terms is irrelevant. 


We ) da, and ) b, converge absolutely, and {c,} is any sequence containing the 


n=] n=! 
products a;b; for each pair (i, ae then 


Notice first that the sequence 


Ppa a 


i—| 


converges, since {a,} and {b,} are antes convergent, and since the limit of a 
product is the product of the limits. So {pz,} is a Cauchy sequence, which means 
that for any ¢ > 0, if L and L’ are large ke. then 


Sal PD De 


I i=] 


(1) > tail: bil < 


ior j>L 


It follows that 


No | 


Now suppose that N is any number so large that the terms c, for 2 < N include 
every term a,b; for i, j < L. Then the difference 


N 
25 Cr ae dj: y bj 


n=] i=] 
consists of terms a;b; with i > L or j > L, so 


N 


Ss Ci 5 qj: ye b; 


n=] i 


(2) 


< >> fail -1;| 


OW) ate 


<€ by (1). 


But since the limit of a product is the product of the limits, we also have 


fore) foe) it ite 
| 4 > bj ~ ai . > 
— 71 


i=l jel 
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for large enough L. Consequently, if we choose L, and then N, large enough, we 
will have 


which proves the theorem. J 


Unlike our previous theorems, which were merely concerned with summability, 
this result says something about the actual sums. Generally speaking, there 1s 
no reason to presume that a given infinite sum can be “evaluated” in any simpler 
terms. However, many simple expressions can be equated to infinite sums by using 
Taylor’s Theorem. Chapter 20 provides many examples of functions for which 


n (i) 
j(C®) = Sy ee a a)’ ote sae.) 
i=0 2 


where lim Ry q(x) = 0. This is precisely equivalent to 


PD ty aa OB) 


As particular examples we have 


: et ht 
SU aa can alma ain P 
bid? x2 x4 xo 
cosx = Sot? ai are 
pa x (eee 
Sapa Me 2) ah eens 
sane Meee xl <1 
arctan xX = Xx 3 5 7 Xx 
log(1 + x) ae bg Male | = 
5 Xs) OG ame le? ea ae ge eal —I|l<vx 
ves aie i a ae 
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(Notice that the series for arctan x and log(1 +.) do not even converge for |x| > 1: 
in addition, when «x = —1, the series for log(1 + x) becomes 


which does not converge.) 
Some pretty impressive results are obtained with particular values of x: 


n> 1° na! 
me” ~ 307 oT 
l l | 
oS eT sere 
et 
4 Sy 7 
loo 2 = =* ;-qt 


More significant developments may be anticipated if we compare the series for 
sin.x and cos x a little more carefully. ‘The series for cos x is ust the one we would 
have obtained if we had enthusiastically differentiated both sides of the equation 


ra x 
a ae 

term-by-term, ignoring the fact that we have never proved anything about the 
derivatives of infinite sums. Likewise, if we differentiate both sides of the for- 
mula for cos.x formally (i.e., without justification) we obtain the formula cos’(x) = 
—sinx, and if we differentiate the formula for e* we obtain exp’(x) = exp(x). 
In the next chapter we shall see that such term-by-term differentiation of infinite 
sums is indeed valid in certain important cases. 


PROBLEMS 


1. Decide whether each of the following infinite series is convergent or diver- 
gent. The tools which you will need are Leibniz’s ‘Theorem and the compar- 
ison, ratio, and integral tests. A few examples have been picked with malice 
aforethought; two series which look quite similar may require different tests 
(and then again, they may not). ‘The hint below indicates which tests may be 


used. 
” sin n@ 
errs 
n=1 
(ji) I-4+3-—4+ 
(ii) 1-5+3-44+4-4+2-4E+ 
OO 
log 
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_ (The summation begins with n = 2 simply to avoid 
the meaningless term obtained for n = 1). 


sae | 
OL = 
fea I 
a Se 
eal : n + ] 
ee = n- 
(vil) a 
wii) )- - A 
n=1 
Lore 
= logn 
ee 
x 
= (log n)é 
| 
(xi dX, ear 
em al (logn)" 
<iq 
jit) Jo 5 
malt: +1 
he ap ll 
(xiv) yen 
1 
n=l 
bx = | 
x) —nlogn 
(xvi ‘Ss | 
xvl —————— 
) = n(logn)? 
| i DE I 
XVI —___—., 
oa = n2(logn) 


ayo nt! 
(xvii) ) ae 
n 


2 n! 


n” y 


25. Infinite Series 491 


i ! 
(Geax) =a 
n 
fill 
Hint: Use the comparison test for (1), (v), (vi), (ix), (x), (xi), (xi), (xiv), (xvi); 


the ratio test for (vn), (xviii), (xix), (xx); the integral test for (vim), (xv), (xvi). 


‘The next two problems examine, with hints, some infinite series that require 
more delicate analysis than those in Problem 1. 


*2. (a) If you have successfully solved examples (xix) and (xx) from Problem 1, 


OO 
it should be clear that ) a"n!/n" converges for a < e and diverges for 
n=] 
[e.@) 
a >e. Fora = e the ratio test fails; show that ) e"n!/n" actually 
= 


diverges, by using Problem 22-13. 
S / cae 
OO 
(b) Decide when ) n"/a"n! converges, again resorting to Problem 22-13 


n=1 
when the ratio test fails. 


*3. Problem | presented the two series ) (logn)~* and ) (logn)~", of which 
i=” p= 


the first diverges while the second converges. The series 


2 | 


a (log nybos n? 


es 
which lies between these two, is analyzed in parts (a) and (b). 


OO 
(a) Show that {,;* e’/y? dy exists, by considering the series S(e/n)". 
n= 
(b) Show that 
— 


s (log n ylog n 


n=2 


converges, by using the integral test. Hit: Use an appropriate substitu- 
tion and part (a). 
(c) Show that 


i | 


De (log n ylogdlog n) 


n=2 


diverges, by using the integral test. Hint: Use the same substitution as 
in part (b), and show directly that the resulting integral diverges. 
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4, 


: ~ | 
Decide whether or not = “Taha Converges. 
i 
n=| 
oo oe 
(a) Prove that if Yan converges absolutely, then so does an : 
n=] n=] 
*(b) Show that this does not hold for conditional convergence. 
Let f be a continuous function on an interval around 0, and let a, = f(1/n) 
(for large enough 7). 
OO 
(a) Prove that if yo converges, then (0) = 0. 
n=] 0° 
(b) Prove that if f’(O) exists and Da converces, then f (0) —10. 
n=1 oO 
(c) Prove that if f”(0) exists and f(0) = f’(0) = 0, then SEG, converges. 
a0 p=il 
(d) Suppose Digs converges. Must f’(Q) exist? 
n=l O° 
(ce) Silppose: 7 (0) =.f-(0) = 0. Must Soa converge? 
n=] 
& 
(a) Let {a,} be a sequence of integers with 0 < a, < 9. Prove that ee Oe 
n=] 
exists (and lies between 0 and 1). (This, of course, is the number which 
we usually denote by 0.a)a2a3a4....) 
(b) Suppose that 0 < x < 1. Prove that there is a sequence of integers {dy} 
OO 
with 0 < a, < 9 and are = x. Slit: gi orexamplesaip— aie! 
nl 
(where [y] denotes the greatest integer which is < y). 
(c) Shovwiithaiite {d,} is repeating, 1.c,. is of the Sf@rniegy ane er 
BS 
GE, 0) Bee, 2o,..., then > d,10~" is a rational number (and find 
n=) 
it). The same result naturally holds if {a,} is eventually repeating, ie., if 
the sequence {ay 4x} 1s repeating for some N. 
OO 
(d) Prove that if x = a. 10~" is rational, then {a,} is eventually repeat- 
n=] 
ing. (Just look at the process of finding the decimal expansion of p/q 
dividing g into p by long division.) 
Suppose that {a,} satisfies the hypothesis of Leibniz’s Theorem. Use the 


proof of Leibniz’s ‘Theorem to obtain the following estimate: 


fe 3) 
D othe, — [a; —a2+---+ay]| < ay 41. 


n=l 
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le 8) 


9. (ay, Prove thatil @.en0and im “fa, = 7 then ) a, converges if r < |, 


N—> OOo 
=I 


and diverges if r > 1. (The proof is very similar to that of the ratio test.) 
OO 


This result is known as the “root test.” More generally, ) a, converges 
n=1 


if there is some s < | such that all but finitely many ~/a, are < s, and 
lo @) 


) a, diverges if infinitely many ~/a, are > 1. This result is known as the 
n=l 


“delicate root test” (there is a similar delicate ratio test). It follows, using 


the notation of Problem 22-27, that ) a, converges if lim </a, < | 


hae 
n=] 
and diverges if hm Van > 1; no conclusion is possible if im ian 


(b) Prove that if the ratio test works, the root test will also. Hint: Use a 
problem from the previous chapter. 
It is easy to construct series for which the ratio test fails, while the root 
test works. For example, the root test shows that the series 


$4i4474474+G%4+Q%+-- 


converges, even though the ratios of successive terms do not approach a 
limit. Most examples are of this rather artificial nature, but the root test 
is nevertheless quite an important theoretical tool. 


n 


10. For two sequences {dy} and {b,}, let c, = yo ae (1 heives istthe sum 


11. 


12. 


k=] 
of the terms on the nth diagonal in the Epic alee on Bee 486.) ‘The series 
oO 


SS Cy, is called the Cauchy product of Sa and ay 2 =) = 
n=! n=] n=l 

(—1)"/J/n, show that |c,| > 1, so that the Cauchy product does not con- 
verge. 


(a) Consider the collection A of natural numbers that do not contain a 9 in 
their usual (base 10) representation. Show that the sum of the reciprocals 
of the numbers in A converges. Hint: How many numbers between | and 
9 are in A?; how many between 10 and 99?; etc. 

(b) If B is the collection of natural numbers that do not have all 10 digits 
eae 9 in their usual representation, then the sum of the reciprocals of 
the numbers in B converges. (So “most” integers must have all ten digits 
in their representation.) 

A sequence {a,} 1s called Gesaro summable, with Cesaro sum /, if 

es) ain“ tiageSe 
hn — | 


n> 0 n 


(where sx, = a, +--++ a,x). Problem 22-16 shows that a summable sequence 
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is automatically Cesaro summable, with sum equal to its Cesaro sum. Find 
a sequence which is not summable, but which is Cesaro summable. 


13. Suppose that a, > O and {a,} is Gesaro summable. Suppose also that the 
fe@) 


sequence {nrd,} is bounded. Prove that the series ) a, converges. Hint: If 


n=] 
n 
—— ) a; and o, = — ) S;, prove that s,, — ———@,, 1s bounded. 
é re 4 n+] 
i il 
14. ‘This problem outlines an alternative proof of Theorem 8 which does not rely 


on the Cauchy criterion. 


(a) Suppose that a, > 0 for each n. Let {b,} be a rearrangement of {a,}, 
and let s, =a; +--:-+a, and t, = bj +---+b,. Show that for each n 
there is some m with a= <p 


(b) Show that ae 5b; if Pu CRIS{s. 


n=] n=l n=] 
foe) Oo 

(c) Show that ZS a= ‘3 Die 
n=1 n=] 


OO 
(d) Now replace the condition a, > 0 by the hypothesis that Se a, COnverges 
n=! 
absolutely, using the second part of Theorem 5. 
‘@,@) 
15. (a) Prove that if Dy a, converges absolutely, and {b,} is any subsequence of 


n=] 


{ay}, then we converges (absolutely). 


n=1 
0° 


(b) Show that this is false if ) a, does not converge absolutely. 


n=] 
oc 


*(c) Prove that if ) a, converges absolutely, then 


nl 
[e.2) 
Ps, = (a) +43 +05+---)+(ao+4a4+06+-::). 
n=1 
©oO wo 00 
16. Prove that if ee is absolutely convergent, then ay s ae lay|. 
n=l i=l 7 


6 . edly 6 
*17, Problem 19-43 shows that the improper integral fy (sinx)/x dx converges. 
Pye sey] paw meet aoren cen wihseall 7 iemard Bee onstey xe 
Prove that fo |(sin.x)/x|dx diverges. 


*18. 9 Find a continuous function f with f(v) > O for all x such that hae f(x) dx 
exists, but ini f(v) does not exist. 
¥— 00 


BEGIO Rakes 


#19. 


20. 


F2 1, 
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Let f(x) = x sim |/x stor 0 = x =< 1, andulet 70) = 0. Recalisthe “dehmition 
of (C7, P)arom Problent "3-25. show that tlterset of all’ 2( jer imier Pa 
parttion of [0,1] 1s not bounded (thus f has “infinite length”). Hint: Try 
partitions of the form 


9d D: 9 


sees qe Ca ma 


9) 
p= {0 ak om 
(27a lar, 4 


! aie: eee z ! 
Let f be the function shown in Figure 5. Find af f, and also the area of the 
shaded region in Figure 5. 


In this problem we will establish the “bimomial series” 
OO 
(lx) = Gees Weg lec le 
k=0 k 


for any a, by showing that lm R,9(x) = 0. The proof is in several steps, 
n> CO 
and uses the Cauchy and Lagrange forms as found in Problem 20-21. 
= (a 
(a) Use the ratio test to show that the series Ss (t)r does indeed converge 
k=0 
for |r| < | (this is not to say that it necessarily converges to (1 + r)%). It 
: : : : a 
follows in particular that lim ( ip = Oitor |e, 
i= AS.) \\ if} 
(b) Suppose first that 0 < x < 1. Show that lim R,o(x) = 0, by using 
n—- Oo 


Lagrange’s form of the remainder, noticing that (1 + 1)?! aT for 
n+1>a. 
(c) Now suppose that —1 < x < 0; the number t m Cauchy’s form of the 


remainder satisfies —1 < x <1 < 0. Show that 


ot Neyo a | = re, where M = max(1, (1 + x)*%~)), 
and 
oS 


Fj ee 
= be ode 
ey | ae = te 


Using Cauchy’s form of the remainder, and the fact that 


a a— | 
ae n 


show that hm R,.9(x) = 0. 


n—-> CO 


(a) Suppose that the partial sums of the sequence {a,,} are bounded and that 


= 
{b,} 1s a sequence with b, > by; and lim b, = 0. Prove that ) Andy 
ti—> CO 
i=l 


converges. ‘This is known as Durichlet’s test. Hit: Use Abel’s Lemma 
(Problem 19-36) to check the Cauchy criterion. 
(b) Derive Leibniz’s Theorem from this result. 
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coe 


+74. 


720. 


*26. 


27, 


% 
(c) Prove, using Problem 15-33, that the series ) (cosnx)/n converges if x 
: n=1 
is not of the form 2kz for any integer k (in which case it clearly diverges). 
OO 
(d) Prove Abel’s test: If ) a, converges and {by} is a sequence which is either 
n=l 


(@.3) 
nondecreasing or nonincreasing and which is bounded, then ) a, Ps 


n— 


converges. Hint: Consider b, — b, where b= hm by. 
; n— Oo 


fo 8) 
Suppose {a,} 1s decreasing and hm a, = 0. Prove that iF ) ay, converges, 
n= 
CO 


then ) 2" aq also converges (the “Cauchy Condensation Theorem”). No- 


n=" 


tice that the divergence of ) [/n is a special case, for if ) 1 /n converged, 


n=1 nial 
OO 
then ) 2"(1/2") would also converge; this remark may serve as a hint. 


i'l 
OO SS 6) 
: 2 2, 
(a) Prove that if ) on and ) b,” converge, then ) dnb, converges. 
il n=1 nl 
O° fo.) 
ore 9) 
(b) Prove that if a,” converges, then ) a,/n® converges for any a@ > a 
n=1 n=1 
oO 
Suppose {a,} is decreasing and each a, > 0. Prove that if ) dy Converges, 
n=1 
then hm na, = 0. Hint: Write down the Cauchy criterion and be sure to 
{fi OS) 


use the fact that {a,} 1s decreasing. 


foe) 
If ) a, converges, then the partial sums s,, are bounded, and hm a, = 0. 


N= OS 
i 
It is tempting to conjecture that boundedness of the partial sums, together 
CO 
with the condition hm a, = 0, imphes convergence of the series ) Chie 
Hier &, 8) 
n=l 


Find a counterexample to show that this is nof true. Hint: Notice that some 
subsequence of the partial sums will have to converge; you must somehow allow 
this to happen, without letting the sequence of partial sums itself converge. 
OO oS) 
Prove that ifa, > 0 and > ay diverges, then 


i=) i 


ay ‘ F, 
—— also diverges. Hint: 
+ Ay 


Compare the partial sums. Does the converse hold? 
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CO 
28. For b, > O we say that the infinite product [ [> converges 1f the sequence 
n n— 
— [ [2 converges, and also lim p, 4 0. 
n—> Co 


i=] 


oO 
(a) Prove that if I] b, converges, then b, approaches 1. 


n=1 


[o) [o, 2) 
(b) Prove that Ml b, converges if and only if 3 log b, converges. 


n=] n=1 


[o,@) © @) 
(c) For a, > 0, prove that iG + a,) converges if and only if ae con- 


nl n=1 
verges. Hint: Use Problem 27 for one implication, and a simple estimate 


for log(1 + a) for the reverse implication. 


The remaining parts of this Problem show that the hypothesis a, > 0 is 


needed. 


(d) Use the ‘Taylor series for log(1 + x) to show that for sufficiently small x 


we have 
| 


2 ‘ 3 
ee 8 =log(1 +x) < Tee 
[o 2) 
Conclude that if all a, > —1 and S @ converges, then the series 


n=1 


y-log(1 + a,) converges if and only if ox converges. Similarly, 


n=1 n=1 


lo @) ee) 
AP 9 ai 
fala, > —l and ) a,~ converges, then ) log(1 + a,) converges if 
n=] n=| 
[o @) 
and only if ) a, converges. Hint: Use the Cauchy criterion. 


n=1 


(e) Show that 


converges, but 


diverges. 
(f) Consider the sequence 
Sg Ue Pace Ve Ue Lg hl le Be dnd a 
(Gn) = Liss, a a 32 ge ae ae Gs S62) ake 
SH eee eS 
| pair 3 pairs 5 pairs 
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ZS: 


30. 


(compare Problem 26). Show that Pe diverges, but 


n=1 


[ [a sale 


n=1 


(a) Compute I] (1 ~ =); 


n=2 


(b) Compute [ [a + x") for xi te 
n=] 
The divergence of ye 1/n is related to the following remarkable fact: Any 


nl 
positive rational number x can be written as a finite sum of distinct numbers 


of the form 1/n. ‘The idea of the proof is shown by the following calculation 
for oe Since 


Bl T= 23 

31 2 am (62 

OO STN EST 

62 8) ae 186 
7 l l 
GG) de eG 

Ties Mee calls 

18 25) am NOTA: 


we have 
abil | 1 | 
a D3 Tn leva: 
Notice that the numerators 23, 7, | of the differences are decreasing. 


(a) Prove that if 1/(n+1) < x < 1/n for some n, then the numerator in this 
sort of calculation must always decrease; conclude that x can be written 


as a finite sum of distinct numbers 1/k. 
[e,2) 


(b) Now prove the result for all x by using the divergence of Ss Wie 


n=1 


PIGURE t 


fi 


CHAR. 


fa 


UNIFORM CONVERGENCE AND 
POWER SERIES 


The considerations at the end of the previous chapter suggest an entirely new way 
of looking at infinite series. Our attention will shift from particular infinite sums 
to equations like 


i x Sa 


which concern sums of quantities that depend on x. In other words, we are 
interested in functions defined by equations of the form 


fC es (x) + fa) +A 


(in the previous example f, (x) = x"~!/(n — 1)!). In such a situation {f,} will be 
some sequence of functions; for each x we obtain a sequence of numbers { f,(x)}, 
and f(x) is the sum of this sequence. In order to analyze such functions it will 
certainly be necessary to remember that each sum 


PCO RC) falas 
is, by definition, the limit of the sequence 
MO) MAO te Cera Ca) 2 FE 5), eee 
If we define a new sequence of functions {s,} by 
Sn = fi toot fn. 
then we can express this fact more succinctly by writing 


70) = lim, Secs 


n= OO 


For some time we shall therefore concentrate on functions defined as limits. 
ex slim 7.) 
n> CcoO 


rather than on functions defined as infinite sums. The total body of results about 
such functions can be summed up very easily: nothing one would hope to be 
true actually is—instead we have a splendid collection of counterexamples. The 
first of these shows that even if each f, is continuous, the function f may not be! 
Contrary to what you may expect, the functions f, will be very simple. Figure | 
shows the graphs of the functions 


me “O 


fx) = 7 . 


— 
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PIGUIRE 2 


FGI RSE 3 


rlGURE 4 


‘These functions are all continuous, but the function f(x) = lim f(x) is not 
n— 00 


continuous; in fact, 


0. Oera—al 


lim f,(x) = . 
me, In Oe l, xe | 


Another example of this same phenomenon is illustrated in Figure 2; the func- 
tions f, are defined by 


] 
—], ve < eth ea 
hl 
] l 
f= ynx, --<x<- 
a il 
| 
le — <x. 
Hl 


In this case, if x < 0, then f,,(%) is eventually (i.e., for large enough 7) equal to —1, 
and if x > 0, then f,(x) is eventually 1, while /,(0) = 0 for all ». Thus 


—-!l, x <0 
lily foe + 10s x=0 
tins iF Be os (IF 


so, once again, the function f(x) = hm f, (x) is not continuous. 
n— Oo 


By rounding off the corners in the previous examples it 1s even possible to 
produce a sequence of differentiable functions {f,} for which the function f(x) = 
lim f,(x) 1s not continuous. One such sequence is easy to define explicitly: 
1—> 00 


| 
=|" SS = 
n 
Pe sin (“*) L oe oe! 
— pe i) oo oe 
| 
ie — <x 
n 


These functions are differentiable (Migure 3), but we still have 


—l, x<0O 
lim fn(x) = 4 0, & — () 
ii Il a 0: 


Continuity and diflerentiability are, moreover, not the only properties for which 
problems arise. Another difficulty is ilustrated by the sequence {f;,} shown m 
Figure 4; on the interval [0,1/n] the graph of f, forms an isosceles triangle of 
altitude n, while f, (4) = 0 for x > 1/n. These functions may be defined explicitly 
as follows: 


FIGURE 5 


FIGURE 6 
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| 
Pn2x, O<x<— 
2n 
: | | 
Liv < tse, == ae 
2n n 
| 
0, —<x<l. 
n 


Because this sequence varies so erratically near 0, our primitive mathematical 


instincts might suggest that lim f(x) does not always exist. Nevertheless, this 
: gs n> ow : 


limit does exist for all x, and the function f(x) = lim f(x) is even continuous. 
FOS 8.8) 


Insfact, af ay > 0, then y,;(x) isseventnally 0,so lim f,,@¢) = 0; moreovar, 710) 0 


nN OO 
for all n, so that we certamly have lim /,(0) = 0. In other words, f(x) = 
n— 
lin f(x) = O for all x. On the other hand, the integral quickly reveals the 
N-> OO - 


strange behavior of this sequence: we have 


] 
if filX) die= 5, 
0 
but 1 
/ Hoe — 0: 
0 
Thus, 


n— OO 


l | 
im f Sa Goa Wa bs a lim fg) ¢@%. 
° Jo Gi) ae 


This particular sequence of functions behaves i a way that we really never 
imagined when we first considered functions defined by limits. Although it is true 
that 

Fea e— im ne) foreach + imi/O: |i), 


the graphs of the functions f, do not “approach” the graph of f in the sense of 
lying close to it—if, as in Figure 5, we draw a strip around f of total width 2¢ (al- 
lowing a width of ¢ above and below), then the graphs of f, do not le completely 
within this strip, no matter how large an n we choose. Of course, for each x there 
is some N such that the point (x. f,(¥)) hes in this strip for n > N; this assertion 


just amounts to the fact that lim f(x) = f(x). But it is necessary to choose larger 
N— 0O 


and larger N’s as x 1s chosen closer and closer to 0, and no one N will work for 
all x at once. 

The same situation actually occurs, though less blatantly, for each of the other 
examples given previously. Figure 6 illustrates this point for the sequence 


7-10) 


ye ae S| 
me | v2 


: iP 


A strip of total width 2¢ has been drawn around the graph of f(x) = lim f, (+). 
J—SON 


If ¢ < 4, this strip consists of two pieces, which contain no points with second 
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PG Rey 


coordinate equal to 53 since each function f, takes on the value J 3, the graph of 
each f;, fails to he within this str ip. Once again, for each point x there is some N 
such that (x. f,(¥)) lies in the strip for 2 > N; but it is not possible to pick one N 
which wor é for all x at once. 

It is easy to check that precisely the same situation occurs for each of the other 
examples. In each case we have a function f, and a sequence of functions { f,}, 
all defined on some set A, such that 


or olin f(x) for alle im Ae 


‘This means that 


for all ¢ > O, and for all x m A, there is some N such that if n > N, then 


f(x) = r7e9)| << (2 


But in each case different N’s must be chosen for different x’s, and in each case it 
is not true that 


for aller > 0 there is sonie, N such that ior all x in Ay il w =eN, then 


If) — fa) <e. 


Although this condition differs from the first only by a minor displacement of the 
phrase “for all x in A,” it has a totally different significance. Ifa sequence {fi} 
satisies this second condition, then the graphs of /f, eventually he close to the 
graph of f, as illustrated in Figure 7. ‘This condition turns out to be just the one 
which makes the study of limit functions feasible. 


DEFINITION Let {fi} be a sequence of functions defined on A, and let f be a function which 
is also defined on A. Then f is called the uniform limit of {/f,} on A if for 
every € > 0 there is some N such that for all x in A, 


uge NV. then | f@) — fe) = s. 


We also say that { f, } converges uniformly to f onA, or that f;,, approaches 
f uniformly on A. 


As a contrast to this definition, if we know only that 
ee slim, 7,3) for. cach x in A, 
=> CS 


then we say that {f,} converges pointwise to f on A. Clearly, uniform conver- 
gence Imphes pointwise convergence (but not conversely!). 

Evidence for the usefulness of uniform convergence is not at all difficult to amass. 
Integrals represent a particularly easy topic; Figure 7 makes it almost obvious that 
if {fn} converges uniformly to f, then the integral of f, can be made as close 
to the integral of f as desired. Expressed more precisely, we have the following 
theorem. 


THEOREM 1 


PROOF 


THEOREM 2 


PROOF 
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Suppose that {f,} is a sequence of functions which are integrable on [a,b], and 
that {f,} converges uniformly on [a,b] to a function f which is integrable on 


2, 4) When 
b b 


‘=m jing 


a n> CO a 


Let ¢ > 0. There is some N such that for all n > N we have 
i a) = (| =e for all x in [a, Db. 


Thus, if 2 > N we have 


b b 
F(x)dx - Wx) cle 


a a 


b 
a Lf) — fn(x)] dx 


a 


b 
=f ie) ~ folds 


b 
< / 2aX 
a 


=e(b—a). 


Since this 1s true for any ¢ > 0, it follows that 
b 


N&O 


b 
f = lm fil 
a 


a 


The treatment of continuity is only a little bit more difficult, involving an 
“e/3-argument,” a three-step estimate of | f(x) — f(x +/)|. If ( fi} is a sequence 
of continuous functions which converges uniformly to f, then there is some # such 
that 


(1) Lf) = fal < 5. 


Si 
(2) Ife +h) — fale + byl < 5. 


Moreover, since fp 1s continuous, for sufficiently small # we have 


(3) Une) — fale +A) < 5. 


It will follow from (1), (2), and (3) that | f(x) — f(« +/)| < e. In order to obtain (3), 


ina way that cannot be predicted until 7 


however, we must restrict the size of |/ 
has already been chosen; it is therefore quite essential that there be some fixed n 
which makes (2) true, no matter how small || may be—it is precisely at this poimt 
that uniform convergence enters the proof. 


Suppose that {f;,} 1s a sequence of functions which are continuous on [a,b], and 
that {f,} converges uniformly on [a,b] to f. Then f is also continuous on [a, b]. 


For each x in [a,b] we must prove that f is contmuous at x. We will deal only 
with x m (a,b); the cases x =a and x = b require the usual simple modifications. 
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Let e > 0. Since {f,} converges uniformly to f on [a, b], there is some n such 
that 


If) =f) <y forall y in [a,b]. 


In particular, for all / such that x + h is in [a, b], we have 
€ 
(1) If) = fn)I < 3, 


€ 
(2) lf +h) — fax +h)| < 3" 
Now fy, 1s continuous, so there is some 6 > 0 such that for |h| < 6 we have 


€ 
(3) lfn(x) — frn(x +h) < 3" 
Thus, if |h| < 6, then 


|\f(x +h) — f(x)| 
=|f@+h) — frax+h)+ frh@ +h) — fr) + fr) — f@)| 
<\f@+h)— fi +h)|+lAe+h) = f@)|4+ |fi.@)= f@)| 


2 See 
<= _ — 
2 al ea, 
='6. 


This proves that f is continuous at x. 


f &) = 


FIGURE 8 


After the two noteworthy successes provided by Theorem | and Theorem 2, 
the situation for differentiability turns out to be very disappomting. If each f, is 
differentiable, and if { f,,} converges uniformly to f, it is still not necessarily true 
that f is differentiable. For example, Figure 8 shows that there is a sequence of 
differentiable functions { f,,} which converges uniformly to the function f(x) = |x|. 


THEOREM 3 


PROOF 


24. Uniform Convergence and Power Series 505 


Even if f zs differentiable, it may not be true that 
ocr lim fy, (x): 
n> Oo 
this is not at all surprising if we reflect that a smooth function can be approximated 


by very rapidly oscillating functions. For example (Figure 9), if 


eee 
He) ee) 
n 
then { f,} converges uniformly to the function f(x) = 0, but 


fa'(x) =ncos(n7x), 


and lim ncos(n?x) does not always exist (for example, it does not exist if x = 0). 
n—0o 


1 


Sh 


AMAANANAAAAAAAAAAMAAAAAAAAAAASAMMULLAAAAAAAAMMUUULAAANANAAA 
VV VV 


FIGURE 9 =a! 


Despite such examples, the Fundamental Theorem of Calculus practically guar- 
antees that some sort of theorem about derivatives will be a consequence of Theo- 
rem |; the crucial hypothesis is that { f,’} converges uniformly (to some continuous 
function). 


Suppose that {/,} 1s a sequence of functions which are differentiable on [a, b], 
with integrable derivatives f,’, and that { f,} converges (pointwise) to f. Suppose. 
moreover, that { f,’} converges uniformly on [a, b] to some continuous function g. 


Then f is differentiable and 
A) lime, Co). 
n->>CO 


Applying Theorem | to the interval [a, x], we see that for each x we have 


= lim [ fle) — frla)] 
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Since g is continuous, it follows that f’(v) = g(x) = lim f,,’(x) for all x in the 
i> CS 
interval [a,b]. J 


Now that the basic facts about uniform limits have been established, it is clear 
how to treat functions defined as infinite sums, 


ff) = fiG)+ f+ AG)+---. 
This equation means that 
f(x) = hm fia) +--- + fae): 
our previous theorems apply when the new sequence 
i Pk fake 2 es 


converges untformly to f. Since this is the only case we shall ever be interested 
in, we single it out with a definition. 


oo 


DEFINITION ‘The series > fn, converges uniformly (more formally: the sequence { f;,} is 


nil 
uniformly summable) to f on A, if the sequence 


wees fa. Si + Yoo. 


converges uniformly to f on A. 


We can now apply each of Theorems |, 2, and 3 to uniformly convergent series; 
the results may be stated in one common corollary. 


OO 
COROLLARY Let “2 fn converge uniformly to f on [a, bd]. 
n=l 
(1) Ifeach f, is continuous on [a,b], then f ts continuous on [a, bd]. 
(2) If f and each f, is integrable on [a, b], then 


b © b 
f= a Sn- 
a n=1 a 
CO 
Moreover, if ye fn converges (pointwise) to f on [a,b], each f, has an integrable 


n=] 
ee) 


derivative f;,’ and ) fn converges uniformly on [a,b] to some continuous fune- 


n=l 
tion, then 


8) f= 3 Ga) for all x in [a, bd}. 


n=] 
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PROOF — (1) Ifeach f,, ts continuous, then so is each f, +---+ f,, and f is the uniform limit 
of the sequence fi, fi + fo, fit fo + fa, ..., 80 f is continuous by Theorem 2. 
(2) Since fi. fit fo, fit fot fs, ... converges uniformly to f, it follows from 

Theorem | that 


b b 
[ faim [itt i 


b b 
= slim ( fit f A) 
Note a a 


©O b 


(3) Each function fj +---+ f, is differentiable, with derivative fj’ +---+ fh’, 
and fi’, fi’+ fo’, fi' + fo’ + fa’, ... converges uniformly to a continuous function, 
by hypothesis. It follows from Theorem 3 that 


f(x) = lim [fi'@) +++ + fa’) 


— s te Ow: i 


n=1 


At the moment this corollary ts not very useful, smece it seems quite difficult to 
predict when the sequence f), fit+f2, fitfot+ fs... will converge untformly. The 
most unportant condition which ensures such uniform convergence 1s provided by 
the following theorem; the proof is almost a triviality because of the cleverness 
with which the very simple hypotheses have been chosen. 


THEOREM 4 Let {fr} be a sequence of functions defined on A, and suppose that {M,,} is a 
(THE WEIERSTRASS M-TEST) — sequence of numbers such that 


tf, Oc,),| VE: for all x in A. 


OO OO 
Suppose moreover that ) M,, converges. ‘Then for each x in A the series ) a) 


=I i 
os 


converges (in fact, it converges absolutely), and ) fn converges untformly on A 


nial 


nal 


to the function 
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lo 2) 
PROOF For each x in A the series sa | fn(x)| converges, by the comparison test; conse- 


n=1 


quently Ds fn(x) converges (absolutely). Moreover, for all x in A we have 


n=1 


eS) 


n=N+1 


SHAG) 


n=N+1 


lo @) 
SS M,. 


n=N+1 


| fF) — [fi@) +---+ fv@)] | 


lA 


A 


oo lo 2) 

Since 2 M,, converges, the number » M,, can be made as small as desired, 
n= n=N+1 

by choosing N sufficiently large. § 


f(x) = {x} 


fix) = ${2x} 


FIGURE 10 


The following sequence {/,} illustrates a simple application of the Weierstrass 
M-test. Let {x} denote the distance from x to the nearest integer (the graph of 


(a) f (x) = {x} is illustrated in Figure 10). Now define 

fal) = —(10"x) 

n = Xf. 

10” 
1} fa) = 7142} woe bier 
8 The functions f; and fz are shown in Figure 11 (but to make the drawings simpler, 
1 10” has been replaced by 2”). ‘This sequence of functions has been defined so that 
the Weierstrass M-test automatically applies: clearly 


(b) 

] 
n At ( all ; 
lin) S 10" for all x 


FIGURE 11 


THEOREM 5 


PROOF 


24. Uniform Convergence and Power Series 509 


9° oO 
and ) 1/10" converges. Thus ) fn converges uniformly; since each f, 1s con- 


n=1 n=] 
tmuous, the corollary implies that the function 


J 
fO) = D7 In) = Dp (10"} 
ny n=] 
is also contunuous. Figure 12 shows the graph of the first few partial sums f| + 


++» + fn. Asn increases, the graphs become harder and harder to draw, and 
OO 


the infinite sum ) fn IS quite undrawable, as shown by the following theorem 


ll 
(included mainly as an interesting sidelight, to be skipped if you find the going too 


rough). 


The function 


is continuous everywhere and differentiable nowhere! 


We have just shown that f is continuous; this is the only part of the proof which 
uses uniform convergence. We will prove that f is not differentiable at a, for 
any a, by the straightforward method of exhibiting a particular sequence {h,,} 
approaching 0 for which 

im La thm) = F@) 


m—0o Ry, 


does not exist. It obviously suffices to consider only those numbers a satisfying 
QO<a<l. 
Suppose that the decimal expansion of a is 


GW) 00030m...« 


et 1 ale” it redo, but.let Ag = —1Op” iane—eber 9 (the reasom for 
these two exceptions will appear soon). ‘Then 


Nita ie.) — f@) 5 1 {10"(a +/im)} ~ (10"a} 
— S10" 0S? 


h 
m A l 


=) > £10" "[{10"(a + fam)} — {10"a}]. 


pel 
This infinite series 1s really a finite sum, because if n > m, then 10"/,, is an integer, 
te) 
{10"(a +h,,)} ~ {10"a} = 0. 


On the other hand, for n < 1m we can write 


lOfa.=—imitever= Oia, (G_eod, a3. . Gi oe 
10"(@t hy) = mteger + 0.4,4. 109400143... (@, + 1).... 
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(in order for the second equation to be true it 1s essential that we choose hy, = 
—10-”" when a, = 9). Now suppose that 


tol — 


OG 1 $244.3 any = Se 

‘Then we also have 
i 
Qa 4 9A 1 elle Cp ate ee 5 


(m the special case m = n + 1 the second equation is true because we chose 
hm = —10~" when a,, = 4). This means that 


[10"(a + him)} — {10"a} = £10°-", 


. Thus, 


tol— 


and exactly the same equation can be derived when 0.4y4.14)424n43-.. > 
for n < im we have 


IO ee [{10"(@ +h, ) PFO ayP= Ee 


ay 

pe) 
~~ 

TS) Lee 


In other words, 
flathny— f(@ 
hy, 
is the sum of mm — 1 numbers, each of which is +1. Now adding +1 or —I toa 
number changes it from odd to even, and vice versa. The sum of m — | numbers 
each +1 is therefore an even integer if m is odd, and an odd integer if m is even. 
Consequently the sequence of ratios 


fla se ie) = fla) 


Fi, 


cannot possibly converge, since it 1s a sequence of integers which are alternately 


(b) 5 odd and even. J 
In addition to its role in the previous theorem, the Weierstrass M-test is an ideal 
tool for analyzing functions which are very well behaved. We will give special 
Pita apa 3 ot attention to functions of the form 
oO 
no — ye a,(x —a)", 
n=0 


which can also be described by the equation 


ieee— 3S i), 


n=0 


Nl— 


hIGURE 12 for fy(x) = a,(x — a)". Such an infinite sum, of functions which depend only 
on powers of (x — a), is called a power series centered at a. For the sake of 


simplicity, we will usually concentrate on power series centered at 0, 


oN) 


t(x)= ye ania 


n=0 


THEOREM 6 
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One especially important group of power series are those of the form 


fa) 


n! 


Co 


(x a Q)" ‘ 
n=0 


where f is some function which has derivatives of all orders at a; this series is 
called the Taylor series for f at a. Of course, it is not necessarily true that 


[e,2) 


io) n 
(QDs eT ) 
n=0 
this equation holds only when the remainder terms satisfy lim R)ya(x) = 0. 


noo 
io, @) 


We already know that a power series ) a,x" does not necessarily converge for 


n=0 
all x. For example, the power series 


converges only for |x| < 1, while the power series 


vee rn a xe i ie a 
EXG — —_—_— ll — see 
2 3 a 5) 


converges only for —1 < x < 1. It is even possible to produce a power series which 
converges only for x = 0. For example, the power series 


[o,@) 


) nice 


n=0 


does not converge for x # 0; indeed, the ratios 


(n +1)! @"*) 


= (n+ 1)x 
mint 
are unbounded for any x 4 0. If a power series ) a,x" does converge for 
n=0 


oo 
some x9 # 0 however, then a great deal can be said about the series ) G,%° {or 


n=0 
|x| < |xol. 


Suppose that the series 
ss 
Ff (xo) = Yan x0" 
n=0 


converges, and let a be any number with 0 < a < |xo|. Then on [—a, a] the series 


f(x)= 3 Gk” 


n=0 
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converges uniformly (and absolutely). Moreover, the same is true for the series 


CO 
2) = Signore 
n=1 
Finally, f is differentiable and 
CO 
jC = Sinai 
n=1 
for all x with |x| < |xo|. 
lo 2) 
PROOF Since y) anxo" converges, the terms da,x9" approach 0. Hence they are surely 
n=0 


bounded: there is some number M such that 
laecco | =lan|i-axor,|) = for all n. 
Now if x is in [—a, a], then |x| < |a|, so 
(gies | = lan| - |x” | 


= lan | i la” | 
n 


(this is the clever step) 


a 
lan| + |xol" - | = 
x 


n 
a 


x0 


M 


But |a/xo| < 1, so the (geometric) series 


ym 


n=0 


n 


l 
Ke 


a 
x0 


converges. Choosing M - |a/xo|" as the number M,, in the Weierstrass M-test, it 
[o @) 


follows that ane converges uniformly on [—a, a]. 
n=0 


CoO 


To prove the same assertion for g(x) = ina y notice that 


n=1 
Ina,x" | =F) 3/7 ie [x21 
< n|ay| + |a"~"| 
lan | aur 
= =. [rol n | = 
la| x 
M al 
< —=n)| — 
la| | xo 
Since |a/xo| < 1, the series 
or a ' Me Salsas? 
—n|— =—) in — 
la| | xo |a| Xo 
n=1 n=1 


converges (this fact was proved in Chapter 23 as an application of the ratio test). 
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Ps, 
Another appeal to the Weierstrass M-test proves that Sea converges unl- 
n=1] 
formly on [—a, a]. 
Finally, our corollary proves, first that g ts continuous, and then that 
CO 
CLS y= y agax” for x in [—a, a]. 

n=] 
Since we could have chosen any number a with 0 < a < |xo|, this result holds for 
all x with |x| < |xo|. 


We are now in a position to manipulate power series with ease. Most algebraic 
manipulations are fairly straightforward consequences of general mone Ni about 


CO 
infinite series. For example, suppose that f(x) = ) a,x and) eO)) = y fie, 
n=0 n=0 
where the two power series both converge for some xo. ‘Then for |x| < |xo| we 
have 
> OnXe ate ) DypXue = ) (Cee = Dire) — ) (a, + Date 
n=0 n=0 n=0 n=0 


8) 
So the series h(x) = we: + b,)x" also converges for |x| < |xo|, and 1 = f +2 


n=0 
for these Ww: 
The treatment of ue IS 1 a litthe more mvolved. If |x| < |xo|, then we 


know that the sertes ee plomenaya s b,x" converge absolutely. So it follows from 


n=0 n=0 
Theorem 23-9 that the product y ae . SD b,x" 1s given by 
n=0 n=0 
'e, @) OO 
by = ajx' bjx!, 
i 0 


where the elements ajx'bjx/ are arranged in any order. In particular, we can 


choose the arrangement 
9 
agbo + (agb) + a1 bo)x + (agb2 + ayb, + azrbo)x~ + -- 


which can be written as 


(eG) n 
Ce for Ch = ) ap Dy_k. 


n=0 k=0 
This is the “Cauchy product” that was introduced in Problem 23-10. Thus, the 
OO 
Cauchy product A(x) = ) Gx also converces-for |x| =<) |xq| and fi — fe for 
n=0) 


these x. 
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fo 2) 
Finally, suppose that f(x) = Dioarx”: where a9 >= O,:so that f O) = ap, +0. 
n=0 
lo, 2) 
Then we can try to find a power series b,x" which represents |/f. This means 
n=0 


that we want to have 


00 00 
bas = Se 0 Ore eee 
n=0 n=0 


Since the left side of this equation will be given by the Cauchy product, we want 
to have 
agbo =.) | 


agb; + ajbp = O 
agb2 + a,b, + arbo = O 


Since ag 4 0, we can solve the first of these equations for bg. ‘Then we can solve 
[o@) 


the second for b;, etc. Of course, we still have to prove that the new series yy bax” 
n=0 


does converge for some x # 0. This is left as an exercise (Problem 18). 
For derivatives, Theorem 6 gives us all the information we need. In particular, 


when we apply Theorem 6 to the infinite series 


: Xo ind = ool eee 
sin x weal S20 (50 ato 
5 
| Ge 2 ee, ee Race 
eee. 2.) eh 
9) 
e+ quae oak, Gt 


we get precisely the results which are expected. Each of these converges for any x0, 


hence the conclusions of Theorem 6 apply for any x: 


3x2 5x4 


sin’(x) = 1 — Ay + 5, ae =iCOsees 
oe 2 Ax one Che 

Co) Sl moi eye 
; 2x~ (30s 

Exp) Ca) — a + ai =i = EXP (ot). 


For the functions arctan and f(x) = log(1 +.) the situation 1s only slightly more 
complicated. Since the series 
Debs sacs 
arctan! =). > stati 


3 a) 
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converges for xg = |, it also converges for |x| < 1, and 


9 / 
arctan’ (x) = 1—x*4+x4=—x°4..-= —— for tel < 1. 
I tee 
In this case, the series happens to converge for x = —1 also. However, the formula 
for the derivative is not correct for x = | or x = —]; indeed the series 
D 
| = ae eee 
diverges for x = | and x = —1. Notice that this does not contradict Theorem 6, 
which proves that the derivative is given by the expected formula only for |x| < |xol. 
Since the series 
: 
waa xX ff gel ee e oe 
og x)=ex- = —_— — — ——--- 
2 3 4 5 
converges for x9 = I, it also converges for |x| < 1, and 
I es 
=log(l+x)=1l—-x+x4°-x°+--: for [vl 
os 
In this case, the original series does not converge for x = —1; moreover, the 


differentiated series does not converge for x = 1. 
All the considerations which apply to a power series will automatically apply to 
its derivative, at the points where the derivative is represented by a power series. 


If 
(@ 8) 
eo SS AX” 
in) 
converges for all x in some interval (—R, R), then Theorem 6 implies that 


CO 


Ie = Siriaas 


nol 


for all x in (—R, R). Applying Theorem 6 once again we find that 


OO 


Ns) = Yonin — Dake, 


n=2 


and proceeding by induction we find that 


ioe) 


f°) = Yo n(n =f). peel aaa 


n=k 


Thus, a function defined by a power series which converges in some interval 
(—R, R) is automatically infinitely differentiable in that interval. Moreover, the 
previous equation implies that 


f©O) = kag, 


so that 
ow) 
= ee 
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In other words, a convergent power series centered at O is always the Taylor series at 0 of the 
function which vt defines. 


On this happy note we could easily end our study of power series and ‘Taylor 
series. A careful assessment of our situation will reveal some unexplained facts, 
however. 

The ‘Taylor series of sin, cos, and exp are as satisfactory as we could desire; 
they converge for all x, and can be diflerentiated term-by-term for all x. The 
‘Taylor series of the function f(x) = log(1 +x) is slightly less pleasing, because it 
converges only for —1 <x < 1, but this deficiency is a necessary consequence of 
the basic nature of power series. If the ‘Taylor series for f converged for any xo 


with |xo| > 1, then it would converge on the interval (—|xo|, |xo|), and on this 
interval the function which it defines would be differentiable, and thus continuous. 
But this is impossible, since it is unbounded on the interval (—1. 1), where it equals 
log(] +x). 

The ‘Taylor series for arctan is more difficult to comprehend— there seems to 
be no possible excuse for the refusal of this series to converge when |x| > 1. This 
mysterious behavior is exemplified even more strikingly by the function f(x) = 
1/( + x7), an infinitely differentiable function which is the next best thing to a 
polynomial function. The ‘Taylor series of f is given by 


] 
f(x) = —j = 1- xt + xt 
) 


ses te — Oe 

If |x| > | the Taylor series does not converge at all. Why? What unseen obstacle 
prevents the ‘Taylor series from extending past 1 and —1? Asking this sort of 
question is always dangerous, since we may have to settle for an unsympathetic 
answer: it happens because it happens— that’s the way things are! In this case 
there does happen to be an explanation, but this explanation is impossible to give 
at the present time; although the question is about real numbers, it can be answered 
intelligently only when placed in a broader context. It will therefore be necessary 
to devote two chapters to quite new material before completing our discussion of 
‘Taylor series in Chapter 27. 


PROBLEMS 


1. For each of the following sequences {f,}, determine the pointwise limit of 
{fn} (if it exists) on the indicated interval, and decide whether { f,} converges 
uniformly to this function. 


GO) gare) = Ve Geo LO; Hil. 


- eee x< 
in) fn) = x-n x> 


n 
on fa, b], and on R. 
n, 
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(i) fale) =<, lett es 


(iv) fa(x)=e-™, on [-1, 1]. 


Oho) = mont 


This problem asks for the same information as in Problem 1, but the functions 
are not so easy to analyze. Some hints are given at the end. 


(i) fa(x) =x" — x?" on [O, 1]. 


35 nx 
(11) Fale) = [eae on [0, CO). 


(iii) fue) = y/x2+ = on [a, 0), a > 0. 
(iv) fn(x) = yfx?+ - on R. 


(i) if.) = xt- — ./x on [a, 00), a > 0. 


Wa) Jee) — zt — ./x on [0, 00). 


(vii) fx(x) =n (\ + - - i) on [a, 00), a > 0. 
(wall)! f(x) = 7 (\: + - — 5) on [0, oo) and on (0, 00). 


Hints: (i) For each n, find the maximum of | f — f,| on [0, 1]. (ii) For each n, 
consider | f(x) — f,(x)| for x large. (iii) Mean Value Theorem. (iv) Give a 
separate estimate of | f(x) — f,(x)| for small |x|. (vii) Use (v). 


Find the ‘Taylor series at 0 for each of the following functions. 


1 
@ f@= , a#0. 


2 0! 


(ie) JG) =leG—2@), a0) 


(iii) f(x)= =(1—x)7'/?, (Use Problem 20-21.) 


| 
Vl—x 

l 
Vie 


(v) f(x) = arcsin x. 


Qv) f@)= 
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Find each of the following infinite sums. 


(Gry ae ee 
Hint: What is 1 — x + x2 —x24+---? 


for |y|p=al 


wD) 
255 x? ne x? 


Gi) ee eT. torial 


2 8 52h ae Sit 
Hint: Differentiate. 


Evaluate the followimg infinite sums. (In most cases they are f(a) where a 
is some obvious number and f(x) is given by some power series. ‘To evalu- 
ate the various power series, manipulate them until some well-known power 
series emerge.) 


c es (—1)"22" 772” 
0) ys (2n)! 
n=0 


(u) ya so 


n= 


(iii) Br 


ie 


\ nN 
iv) oe 


n° 
n=0 


2n+ 1 


2"n! 


(vi) 


W) v— 3"(n + 
n=0 
Pe 


If f(x) = (snx)/x for x 4 0 and f(O) = 1, find f(O). Hint: Find the 


power series for f. 


CO 
5 ‘ ; j a 
In this problem we deduce the binomial series (1 +x )* = ) ( ie belt 
n 
n=0 


without all the work of Problem 23-21, although we will use a fact established 


=e 
in part (a) of that problem—the series f(x) = ) ( iB does converge for 
n 
n=0 


cl <ely 


10. 


11. 
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Prove that (1 + x) f’(x) = a@f(x) for |x| < 1. 

Now show that any function f satisfying part (a) 1s of the form f(x) = 
c(1 +x) for some constant c, and use this fact to establish the binomial 
series. Hint: Consider g(x) = f(x)/(1 + x)*. 


ee 


Suppose that f, are nonnegative bounded functions on A and let M, = 
ge oo 


sup fn. If Ss fn converges uniformly on A, does it follow that 2 M,, con- 


n=1 n=1 
verges (a converse to the Weierstrass M-test)? 


Prove that the series 
[o.@) 
Dosa 
n(l +nx2) 
n=] 
converges uniformly on R. 


(a) Prove that the series 


e.) 
22's 


n=0 


converges uniformly on [a, oo) for a > 0. Hint: lim(sinh)/h = 1. 


h> 
(b) By considering the sum from N to oo for x = 2/(23%), show that the 
series does not converge uniformly on (0, oo). 


(a) Prove that the series 


converges uniformly on [a, 00) for a > 0. Hint: First find the maximum 
of nx/(1 +n*x*) on [0, ov). 
(b) Show that 


and by using an integral to estimate the sum, show that FAV ONE See 
Conclude that the series does not converge uniformly on R. 


(c) What about the series 


©, 2) 
Sane x2- 


n=0 
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12. (a) 


13. (a) 


Use Problem 15-33 and Abel’s Lemma (Problem 19-36) to obtain a “uni- 
form Cauchy condition”, showing that for any ¢ > 0, 


n 


sin kx 
ES 


k=m 


can be made arbitrarily small on the whole interval [¢, 27 — e] by choos- 
ing m (and n) large enough. Conclude that the series 


COC; 
3 sim 1X 
n 


n=1 


converges uniformly on [¢, 27 — €] for € > 0. 
For x = 2/N, with N large, show that 


2N N 


) SAX | — ) sinkx| > —. 
u 


2 


Conclude that 


N. 
sin kx ] 
= gS, 


k ae 


k=N 
and that the series does not converge uniformly on [0, 27]. 


le, @) 
Suppose that f(x) = cee converges for all x in some interval 


n=0 
(—R, R) and that f(x) = 0 for all x in (—R, R). Prove that each a, = 0. 


(If you remember the formula for a, this is easy.) 


Suppose we know only that f(x) = 0 for some sequence {x,} with 
lim x, = 0. Prove again that each a, = (. Hint: First show that 
n—->©o 


f (0) = ap = 0; then that f’(0) = a1 = 9, ete. 


This result shows that if f(x) = e~!/" sin 1/x for x #0, then f cannot 
possibly be written as a power series. It also shows that a function defined 
by a power series cannot be 0 for x < 0 but nonzero for x = J—-thus 4 
power series cannot describe the motion of a particle which has remained 
at rest until time 0, and then begins to move! 


CO CO 
Suppose that f(x) = ae alice) So bax” converge for all x 


n=0 n=0 
in some interval containing 0 and that f(tn) = 2(tm) for some sequence 


{tm} converging to 0. Show that a, = b, for cach 77. 


14. . Prove; thatify = OS re is an even function, then a, = O for 7 odd, 


and if f is an odd function, then a, = 0 for n even. 


15. 


= lie: 


LZ 


18. 
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Show that the power series for f(x) = log(] — x) converges only for —1 < 
x < 1, and that the power series for g(x) = log[(] +.x)/(1 — x)] converges 
only for x in (—1, 1). 


Recall that the Fibonacci sequence {a,} is defined by a; = a2 = 1, ayy) = 
674-4), 1- 


(a) Show that a,+1/a, < 2. 
(b) Let 
OO 


f(x) = ae =ltxt2x743x°4---, 


ll 


Use the ratio test to prove that f(x«) converges if |x| < 1/2. 


(c) Prove that if |x| < 1/2, then 


—| 
f(x) = ema 
Hint: ‘This equation can be written f(x) — xf (x) — KF) =e 
(d) Use the partial fraction decomposition for 1/(x? +.x — 1), and the power 
series for 1/(x — a), to obtain another power series for /f. 
(e) Since the two power series obtained for f must be the same (they are 
both the ‘Taylor series of the function), conclude that 


ba/5 n 1 8/5 n 


») 2 


- -_ 


Cn = 
J5 
io) lo.) 
A eo) = a and g(x) = ae Suppose we merely knew that 
n=0 n=0 
le, @) 
9 aia ed 9) ee — De CX" for some c,, but we didn’t know how to multiply series 
n=O 


in general. Use Leibniz’s formula (Problem 10-20) to show directly that this 
series for fg must indeed be the Cauchy product of the series for f and g. 


Suppose that f(x) = ) a,x" converges for some xo, and that agp 4 0; 


for stmplicity, we'll assume that a9 = |. Let {b,} be the sequence defined 
recursively by 


bo = | 


n—-1 


Db, =— » Di. Gy} 
k=0 
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% 
Vhe aim of this problem is to show that ) b,x" also converges for some 
; : n=) 
x #Q, so that it represents 1/f for small enough ||. 
(a) Ifall la,xo"| < M, show that 


n—] 


: ak 
lbnxo"| <M Y~ [bexo'|- 
k=0 


(b) Choose M so that |a,x9"| < M, and also so that M/(M2 — 1) < 1. Show 


that 
lb,xX9"| < M 2H 
OO 
(c) Conclude that i 2. converges for |x| sufficiently small. 

n=0 

OO OO 

*19. Suppose that eG, converges. We know that the series f(x) = ya 
n=0 n=0 


must converge uniformly on [—a,a] for 0 < a < 1, but it may not converge 

uniformly on [—1, 1]; in fact, it may not even converge at the point —1 

(for example, if f(x) = log(] + x)). However, a beautiful theorem of Abel 

shows that the series does converge uniformly on [0, 1]. Consequently, f is 
ie,2) OO 


continuous on [0, 1] and, in particular, ) = I ) a,x". Prove Abel’s 


i 


=L0) n=0 
Theorem by noticing that if |a,,-++---+a,| < ¢, then |a,x!" +---+a,x"| < 8, 
by Abel’s Lemma (Problem 19-36). 
[e,2) 
20. A sequence {a,} 1s called Abel summable if hm ae" exists; Prob- 
AIS = 
n=0 
lem 19 shows that a summable sequence is necessarily Abel summable. Find 
a sequence which is Abel summable, but which is not summable. Hint: Look 
over the list of Taylor series until you find one which does not converge at 1, 
even though the function it represents is continuous at |. 


21. (a) Using Problem 19, find the following infinite sums. 


(o,@) CO 
(b) Let ) Cn be the Cauchy product of two convergent power series ) an 
n=0 n=0 


OO OO 
and b,, and suppose merely that ) Cn converges. Prove that, in fact, 
n=0 n=0 


oe oO 
it converges to the product ) Gi ) be 
n=0) n=0 


22 


23. 


PES 


20% 


26. 


27. 


(a) 
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Show that the series 


oo rt yt 


1 2n +2 
n= 
converges uniformly to }log(x + 1) on [—a.a] for 0 < a < 1, but that 
at | it converges to log 2. (Why doesn't this contradict Abel’s ‘Theorem 
(Problem 19)?) 


Suppose that {f,,} is a sequence of bounded (not necessarily continuous) 
functions on [a,b] which converge uniformly to f on [a,b]. Prove that 
f 1s bounded on [a, b]. 

Find a sequence of continuous functions on [a, b] which converge point- 
wise to an unbounded function on [a, 5]. 


Suppose that f is differentiable. Prove that the function f’ is the pointwise 
limit of a sequence of continuous functions. (Since we already know exam- 


ples of discontinuous derivatives, this provides another example where the 


pointwise limit of continuous functions is not continuous.) 


Find a sequence of integrable functions {f;,} which converges to the (nonin- 
tegrable) function f that is | on the rationals and 0 on the irrationals. Hint: 
Each f, will be 0 except at a few points. 


(a) 


(b) 


(c) 


Prove that if f is the uniform limit of {f,} on [a,b] and each f, is 
integrable on [a, b], then so is f. (So one of the hypotheses in Theorem ! 
was unnecessary.) 

In Theorem 3 we assumed only that { f,,} converges pointwise to f. Show 
that the remaining hypotheses ensure that {f,} actually converges uni- 
formly to f. 

Suppose that in Theorem 3 we do not assume { f,} converges to a func- 
tion f, but instead assume only that f, (x9) converges for some x9 mm 
[a, b]. Show that f,, does converge (uniformly) to some f (with f’ = g). 
Prove that the series 

‘I (ea 

Il x tn 


converges uniformly on [Q, 00). 


Suppose that f, are continuous functions on [0, 1] that converge uniformly 
tom Provethat 


l-I/n ] 
lim if ja= i The 
fame FH 0 


Is this true if the convergence isn’t uniform? 
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28. 


29. 


30. 


(a) Suppose that {/,} is a sequence of continuous functions on {a,b} which 
approaches 0 pointwise. Suppose moreover that we have fi(«) = fnai(x) 
> 0 for all n and all x in [a,b]. Prove that {f,} actually approaches 0 
uniformly on [a,b]. Hint: Suppose not, choose an appropriate sequence 
of pomts x, in [a,b], and apply the Bolzano-Weierstrass theorem. 

(b) Prove Dinr’s Theorem: If { f,} is a nonincreasing sequence of continuous 
functions on [a,b] which approaches the continuous function f point- 
wise, then {f,} also approaches f uniformly on [a,b]. (The same result 
holds if {f,} is a nondecreasing sequence.) 

(c) Does Dini’s Theorem hold if f isn’t continuous? How about if [a,b] is 
replaced by the open iterval (a, b)? 


(a) Suppose that {/f,} is a sequence of continuous functions on [a,b] that 
converges uniformly to f. Prove that if x, approaches x, then fi,(xn) 
approaches f(x). 

(b) Is this statement true without assuming that the /f, are continuous? 

(c) Prove the converse of part (a): If f 1s continuous on [a,b] and {fr} is 
a sequence with the property that f,(x,) approaches f(+) whenever x, 
approaches x, then f, converges uniformly to f on [a,b]. Hint: If not, 
there is an ¢ > O anda sequence x, with | f, (4) — f(%n)| > & for infinitely 
many distinct x,. Then use the Bolzano-Weierstrass theorem. 


This problem outlines a completely different approach to the integral; con- 


sequently, it is unfair to use any facts about integrals learned previously. 


(a) Let s be a step function on [a,b], so that s is constant on (f;-1.%) for 
Hn 


b 
some partition {fo,.... t,} of [a,b]. Define / Ay als S si(t —t;-,) where 
a i=l 
s; 1s the (constant) value of s on (t;-1,4). Show that this definition does 
not depend on the partition {fo, .... tn}. 

(b) A function f is called a regulated function on {a, 5] if it is the uniform 
limit of a sequence of step functions {s,} on [a,b]. Show that in this 
case there is, for every ¢€ > 0, some N such that for m,n > N we have 
[sy Y= See ete forall x in*[a, bo} 


b 
(c) Show that the sequence of numbers | / | will be a Cauchy sequence. 
a 


(d) Suppose that {f,} is another sequence of step functions on [a@, b] which 
converges uniformly to f. Show that for every ¢ > 0 there is an N such 
that for n > N we have |s,(x) — t,(x)| < € for x in [a, b]. 


Ha & UO 


b b 
(e) Conclude that lim / 5 — Bi i t,. This means that we can define 
a 


a 
b 
f to be lim s, for any sequence of step functions {s,} converging 
a n> % ; 
uniformly to f. “Phe ouly remaiming question is: Which fuuctious are 


regulated? 
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*(f) Prove that a continuous function is regulated. Hint: To find a step func- 
tion s on [a, b| with | f(x) — s(x)| < e for all x in [a,b], consider all y 

for which there is such a step function on |[a, y]. 
(g) Every step function s has the property that lim s(x) and lm s(x) exist 


tai i Ce 
for all a. Conclude that every regulated function has the same property, 
and find an integrable function that is not regulated. (It is also true 
that, conversely, every function f with the property that lim f(x) and 
; x—at 


lim_ f(x) exist for all a is regulated.) 
*31. Find a sequence {f,} approaching f uniformly on [0, 1] for which we have 


lim (length of f, on [0, 1]) 4 length of f on [0,1]. (Length is defined in 


n> Co 
Problem 13-25, but the simplest example will involve functions the length of 


whose graphs will be obvious.) 


CHAPTER COMPLEX NUMBERS 


With the exception of the last few paragraphs of the previous chapter, this book 
has presented unremitting propaganda for the real numbers. Nevertheless, the 
real numbers do have a great deficiency not every polynomial function has a 
root. ‘The simplest and most notable example is the fact that no number x can 
satisfy x7 + 1 = 0. This deficiency is so severe that long ago mathematicians 
felt the need to “invent” a number i with the property that i? + 1 = 0. For a 
long ume the status of the “number” 7 was quite mysterious: since there 1s no 
number x satisfying x7 + 1 = 0, it is nonsensical to say “let i be the number 
satisfying i7 + 1 = 0.” Nevertheless, admission of the “imaginary” number i to 
the family of numbers seemed to simplify greatly many algebraic computations, 
especially when “complex numbers” a + bi (for a and b in R) were allowed, and 
all the laws of arithmetical computation enumerated in Chapter | were assumed 
to be valid. For example, every quadratic equation 


ax? +bx+c=0 (a. NO) 
can be solved formally to give 


Seer b- —t4uc 
2a 


- 


Se = b? — 4ac 


or y= 
2a 


- 


i — 
. 9) ~ . . 
If b- —4ac > 0, these formulas give correct solutions; when complex numbers are 
allowed the formulas seem to make sense in all cases. For example, the equation 
i) 
1m X= — O 
has no real root, since 
a 2 3 . 
x”>txetl=(@+ loge ros ©, for all x. 
But the formula for the roots of a quadratic equation suggest the “solutions” 


hes =p 9 53 
Yy 


eo and x = ——~-——: 


a 
if we understand / —3 to mean /3- (—1) = V3. —| = V3i, then these numbers 
would be 
ih. 64) | ow 3m 


[i © and — 


— —] 


2) 


It ts not hard to check that these, as yet purely formal, numbers do mdeed satisly 
the equation 


xtt+x+1=0. 
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It is even possible to “solve” quadratic equations whose coefficients are themselves 
complex numbers. For example, the equation 


Qe die eng — 


ought to have the solutions 


_-ltJ1-40 +i) _ -14+/-3-4i 


r= 9) 


—- 


where the symbol Y—3 — 44 means a complex number @ + Bi whose square is 
—3— 4. In order to have 


(a + pi)? =a? — B? + 2api = —3 —4i 
we need 


ep =. 
2ap = —4. 


These two equations can easily be solved for real @ and f; in fact, there are two 
possible solutions: 
a=! a 
and 


Thus the two “square roots” of —3 — 47 are 1 — 27 and —1 +2i. There is no 
reasonable way to decide which one of these should be called /¥ —3 — 47, and which 
— /-—3 — 4; the conventional usage of /x makes sense only for real x > 0, m 


which case /¥ denotes the (real) nonnegative root. For this reason, the solution 


—-l+/-3-4i 
= a 


must be understood as an abbreviation for: 


—Il+r 
x =-——5—, where r ts one of the square roots of —3 — 4i. 


- 


With this understanding we arrive at the solutions 


—l+1-2i 
CS CS 
2 
ee Et 
===. . =—_— +1; 


as you can easily check, these numbers do provide formal solutions for the equation 
2 . 
eae tt a 
kor cubic equations complex numbers are equally useful. Every cubic equation 
3 2 
ax” +bx° +cx +d =0 (a 40) 


with real coefficients a, b,c, and d, has, as we know, a real root a, and if we divide 
a 2) . . 
ax” +bx~+cex +d by x —@ we obtam a second-degree polynomial whose roots are 
. a) ~ . . 
the other roots of ax*+bx7+cex+d = 0; the roots of this second-degree polynomial 
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may be complex numbers. ‘Thus a cubic equation will have either three real roots 
or one real root and 2 complex roots. ‘The existence of the real root is guaranteed 
by our theorem that every odd degree equation has a real root, but it is not really 
necessary to appeal to this theorem (which 1s of 10 use at all if the coefficients 
are complex); m the case of a cubic equation we can, with sufficient cleverness, 
actually find a formula for all the roots. ‘The following derivation is presented not 
only as an interesting illustration of the ingenuity of early mathematicians, but as 
further evidence for the importance of complex numbers (whatever they may be). 

‘To solve the most general cubic equation, it obviously suffices to consider only 
equations of the form 


yD ox td = 0. 


. . . . . . 9 ye . . 
It is even possible to eliminate the term involving x~, by a fairly straight-forward 
mampulation. If we let 


b 
xXx=y--c, 
: 3 
then 
pout bty 
x = y’ — by* + —— - —, 
: 3 27 
5 ee Pen es 
<=) 4 — —, 
a 9 
sO 


O=x2 + bx? +ex+d 


a 3 9 3 
3 b- Dips b3 b> be ; 
7 SG | es GOS 


aa 4 A F : 4 : : : 6 
Phe right-hand side now contains no term with y~. [fwe can solve the equation 
for y we can find x; this shows that it suffices to consider im the first place only 
equations of the form 


xo + px+q =0. 


In the special case p = 0 we obtain the equation x? = —q. We shall see later on 
that every complex number does have a cube root, in fact it has three, so that this 
equation has three solutions. ‘The case p 4 0, on the other hand, requires quite 
an mgenious step. Let 


aw 


25. Complex Numbers 529 


‘Then 
3 Xe P 
O=x°+px+q= (w= 2-) + p(w-=)+q 
3w 3w 
3w2p = 3 wp oe p- 
3 
= — — w—-—t+ 
oy 3w Ow? 27w? Re 3w q 
3 
3 
=w —- ——-+g. 
Digs 


This equation can be written 
27(w>)? + 27q(w?) —p=0, 
which is a quadratic equation in w? (!!). 


Thus 
Pe ee.) (27)2q2 +4 - 27p3 


VW = 


phere) 
2 3 
q Y ie ee 
=—-—+,/—+—. 
aD: Aaa, 
Remember that this really means: 
2 3 
3 q : qd Pp 
—— bn i r 1S a SQueée root of — AS 
w 5 +r, where r is a square root 0 7 “ 7 


We can therefore write 


this equation means that w is some cube root of —g/2 +r, where r is some square 
root of q7/4 + p*/27. This allows six possibilities for w, but when these are 
substituted into (%), yielding 


q? p3 


2 4 27 


it turns out that only 3 different values for x will be obtained! An even more 
surprising feature of this solution arises when we consider a cubic equation all of 
whose roots are real; the formula derived above may still involve complex numbers 
in an essential way. For example, the roots of 


eon 0 
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are 4, —2 + 73, and —2 — V3. On the other hand, the formula derived above 


(with p ==15, g = —4) gives as one solution 
3 —15 
v= y24+v4-125 - 
Sry eee 1s 
Ly 
= (2+ 1li + — 
3-V2+4+ 11i 
Now, 
(Qn 22 ae eet ele 
=8+4+12i-6-i 


ele 


so one of the cube roots of 2+ 11i is 2+/7. Thus, for one solution of the equation 


we obtain 


Pa, eee 

6+ 3i 
; ls 6 — 3i 
90 — 45i 
36+ 9 


pe 
aac ii). 


The other roots can also be found if the other cube roots of 2+ 11i are known. 
The fact that even one of these real roots is obtained from an expression which 
depends on complex numbers is impressive enough to suggest that the use of 
complex numbers cannot be entirely nonsense. As a matter of fact, the formulas 
for the solutions of the quadratic and cubic equations can be interpreted entirely 
in terms of real numbers. 

Suppose we agree, for the moment, to write all complex numbers as a + bi, 
writing the real number a as a + Of and the number 7 as 0 + Ii. The laws of 
ordinary arithmetic and the relation i? = —1 show that 


(a+ bi)+(c+di)=(a+c)+(b4+d)i 
(a+ bi)-(c+di) = (ac — bd) + (ad + bedi. 


Thus, an equation like 
Ge 2) Co oa eat 


may be regarded simply as an abbreviation for the “eo equations 


DEFINITION 
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aye : E ¢ é a) . —— 
Phe solution of the quadratic equation ax- + bx + ¢ = 0 with real coefficients 
could be paraphrased as follows: 


if uz — vy =f? — 4ac, 
uv =O, 
(ie. If (a + vi)? =b* — 4ac), 


94 
—b+u\~ v y —btu 
——— } —{— b| ———_ >= Q, 
: ( 2a ) = a 2a ale 
=i 
Afeiren 
2a 2a 


: =p ub uy, 2 —b+u-+oi 
i.e., then @ = ae a a rl ee) 


2a 2a 


then 


It is not very hard to check this assertion about real numbers without writing 
down a single “7,” but the complications of the statement itself should convince 
you that equations about complex numbers are worthwhile as abbreviations for 
pairs of equations about real numbers. (If you are still not convinced, try para- 
phrasing the solution of the cubic equation.) If we really intend to use complex 
numbers consistently, however, it is going to be necessary to present some reason- 
able definition. 

One possibility has been implicit in this whole discussion. All mathematical 
properties of a complex number @ + bi are determined completely by the real 
numbers a and b; any mathematical object with this same property may reasonably 
be used to define a complex number. ‘The obvious candidate is the ordered pair 
(a, b) of real numbers; we shall accordingly define a complex number to be a pair 
of real numbers, and likewise define what addition and multiplication of complex 
numbers is to mean. 


A complex number 1s an ordered pair of real numbers; if z = (a, b) is a com- 


plex number, then a is called the real part of <, and 5 1s called the imaginary 


part of z. The set ofall complex numbers is denoted by C. If (a, b) and (c,d) 
are two complex numbers we define 


(a.b)+(c.d) =(a+c.b+d) 
(a,b)-(c,d)=(a-c—b-d,a-d+b-c). 


(The + and - appearing on the left side are new symbols being defined, while the 
+ and - appearing on the right side are the familiar addition and multiplication 
for real numbers.) 


When complex numbers were first introduced, it was understood that real num- 
bers were, in parucular, complex numbers; if our defhnition is taken seriously this 
is not true areal number is not a pair of real numbers, after all. “This difficulty 
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DEFINITION 


is only a mmor annoyance, however. Notice that 


(a,0O) + (b,0) = (a+ 6,040) = (a +b, 0), 
(a,0)-(b,0) = (a-b-—0-0,a-04+0-b) = (a-b,0); 


this shows that the complex numbers of the form (a, 0) behave precisely the same 
with respect to addition and multiphcation of complex numbers as real numbers 
do with their own addition and multiplication. For this reason we will adopt the 
convention that (a,0) will be denoted simply by a. The familiar a + bi notation 
for complex numbers can now be recovered if one more definition 1s made. 


Notice that i7 = (0, 1) - (0, 1) = (—1.0) = —1 (the last equality sign depends 
on our convention). Moreover 


(a,b) = (a, O) + (0, db) 
= (a, 0) + (6, 0) - (0, 1) 
=at bi. 


You may feel that our definition was merely an elaborate device for defining 
complex numbers as “expressions of the form a+ bi.” That is essentially correct; 
it is a firmly established prejudice of modern mathematics that new objects must 
‘expressions. Nevertheless, it 1s inter- 


6 


be defined as something specific, not as 
esting to note that mathematicians were sincerely worried about using complex 
numbers until the modern definition was proposed. Moreover, the precise defini- 
tion emphasizes one important point. Our aim in introducing complex numbers 
was to avoid the necessity of paraphrasing statements about complex numbers m 
terms of their real and imagmary parts. This means that we wish to work with 
complex numbers in the same way that we worked with rational or real numbers. 
For example, the solution of the cubic equation required writing x = w — p/3w, 
so we want to know that 1/w makes sense. Moreover, w> was found by solving a 
quadratic equation, which requires numerous other algebraic manipulations. In 
short, we are likely to use, at some time or other, any manipulations performed on 
real numbers. We certainly do not want to stop each time and justify every step. 
Fortunately this is not necessary. Since all algebraic manipulations performed on 
real numbers can be justified by the properties listed in Chapter 1, it is only nec- 
essary to check that these properties are also true for complex numbers. In most 
cases this is quite easy, and these facts will not be listed as formal theorems. For 
example, the proof of P1, 


O(c ye rte Wap i Cert) cane oll 


requires only the application of the defimition of addition for complex numbers. 
The left side becomes 


(late] +e, [b+d]+ f/f). 
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and the right side becomes 
(at+[ct+e],b+ [d+ f]): 


these two are equal because P1 is true for real numbers. It is a good idea to 
check P2-P6 and P8 and P9. Notice that the complex numbers playing the role 
of 0 and | m P2 and P6 are (0,0) and (1, 0), respectively. It is not hard to figure 
out what —(a, b) is, but the multiplicative inverse for (a, b) required in P7 is a little 
trickier: if (a,b) 4 (O, 0), then a? +b? #0 and 


a =) 
Dial ec aaa Caen elt ee 
aia (at =e) Sa 
This fact could have been guessed in two ways. To find (x, y) with 
(ab) = Gay) 11.) 


it is only necessary to solve the equations 


ae by = |, 
bx tay =0. 
The solutions are x = a/(a* +b7), y = —b/(a* +b). It is also possible to reason 
that if 1/(a + bi) means anything, then it should be true that 
l l a—bi a—bi 


fobs eh, a= hi a2 ep? 


Once the existence of mverses has actually been proved (after guessmg the inverse 
by some method), 1t follows that this manipulation ts really valid; it is the easiest one 
to remember when the inverse of a complex number is actually being sought—it 


was preciscly this trick which we used to evaluate 
i) “Wie rh 
Oa 8 aE ie i 
20 mess 
~~ BO ick 


Unlike P1-P9, the rules P1O-P12 do not have analogues: it 1s easy to prove that 
there is no set P of complex numbers such that P10 P12 are satisfied for all complex 
numbers. In fact, if there were, then P would have to contain | (since 1 = 1°) and 
also —1 (since —1 = i), and this would contradict P10. The absence of P10 P12 
will not have disastrous consequences, but it does mean that we cannot define 
< < w for complex z and w. Also, you may remember that for the real numbers, 
P10 P12 were used to prove that | + | 4 0. Fortunately, the corresponding fact 
for complex numbers can be reduced to this one: clearly (1,0) + (1.0) 4 (0, 0). 

Although we will usually write complex numbers im the form a + 57, it is worth 
remembering that the set of all complex numbers C ts just the collection of all 
pairs of real numbers. Long ago thus collection was identihed with the plane, and 
for this reason the plane is often called the “complex plane.” ‘The horizontal axis, 
which consists of all poimts (a, 0) for a in R, ts often called the real axis, and the 
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vertical axis 1s called the waginary axis. ‘Two important definitions are also related 
to this geometric picture. 


DEFINITION If z =x +/y is a complex number (with x and y real), then the conjugate Z 
of z is defined as 


Zax —1y, 


and the absolute value or modulus |z| of z is defined as 


lz] =Vx> 4+". 


pe ye ee ae, ae 5 ) ms) Se = : , 
IZLeez =O y=HXHN (Notice that x“ + y~ > 0, so that V.x> + y* 1s defined unambiguously; it denotes 


length 


. . py 2 
the nonnegative real square root of x- + y~.) 


Geometrically, Z 1s simply the reflection of z im the real axis, while |z| is the 
FIGURE 1 distance from z to (0,0) (Figure 1). Notice that the absolute value notation for 
complex numbers is consistent with that for real numbers. ‘The distance between 
two complex numbers z and w can be defined quite easily as |z—w]. The following 
theorem lists all the important properties of conjugates and absolute values. 


THEOREM 1 Let ¢ and w be complex numbers. ‘Then 


(1) 
(2) 


ae 


NI NI 


= 2.if and only ah zais.real (i.c.,..1sol.the formed + Oi. for sonig neal 
number a). 

3) ztw=Z4+w. 

eS 
(Oo) 2 =i 
e-L=(z)'!, f zZ0. 
ae 
Iz] E: 
IZ - w| = [2z| - lw. 


Iz + wl s |z| + lvl. 


ZN 


aA 


PROOF Assertions (1) and (2) are obvious. Equations (3) and (5) may be checked by straight- 
forward calculations and (4) and (6) may then be proved by a trick: 


0=0=724+(-2)=i+-2. so-c=-F, 
i  —= a_i 


an) 
aa 
i) 
| 
CS) 
II 
A 
“nN 
\ 
MN 
o) 
“ny 
| 
Il 
ao 
A 
— 
ihe 


Equations (7) and (8) may also be proved by a straightforward calculation. “he 
only difficult part of the theorem is (9). This inequality has, in fact, already oc- 
curred (Problem 4-9), but the proof will be repeated here, using slightly different 
terminology. 

It ts clear that equality holds in (9) if z = 0 or w = 0. It is also easy to see that (9) 
is true if z = Aw for any real number A (consider separately the cases 4 > Q and 
A <Q). Suppose, on the other hand, that z 4 Aw for any real number A, and that 


TEGO REE 
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w #0. Then, for all real numbers 4, 


() QO <|z- Aw]? (z — Aw) - (z — Aw) 
(z —Aw)-(Z— Aw) 
zz + Ae ww —A(wE + zw) 


A? Jw? + el? — AQwz + zw). 


Notice that wz + zw is real, since 
w2+2w=wz7+7w = wr2+7w = wz+2w. 


Thus the right side of (x) is a quadratic equation in A with real coefficients and no 
real solutions; its discriminant must therefore be negative. Thus 


(wz + cw)? — Alw|? lz|? = (0: 
it follows, since wz + zw and |w|- |z| are real numbers, and |w| - |z| > O, that 
(wz+zw) < 2|w|- |z|. 
krom this equality it follows that 


lz+ w)? =(z+w):-(2+w) 
= |z|* + |wl* + (wz + 2) 
< [2° + |wl? + 2|w] - |z| 
= (\z| + |wl)?, 


which imphes that 


Iz + w| < |z|+ |v. I 


The operations of addition and multiplication of complex numbers both have 
important geometric interpretations. The picture for addition is very simple (Fig- 
ure 2). Two complex numbers z = (a,b) and w = (c,d) determine a paral- 
lelogram having for two of its sides the line segment from (0,0) to z, and the 
line segment from (0,0) to w; the vertex opposite (0,0) is z + w (a proof of this 
geometric fact 1s left to you [compare Appendix | to Chapter 4)). 

The interpretation of multiplication is more mvolved. If c = 0 or w = 0, 
then z+ w = O (a one-line computational proof can be given, but even this 1s 
unnecessary — the assertion has already been shown to follow from PI P9), so we 
may restrict our attention to nonzero complex numbers. We begin by putting every 
nonzero complex number into a special form (compare Appendix 3 to Chapter 4). 

For any complex number z 4 0 we can write 
I= | 


z| Is a positive real number, while 


oo Baa lz| 


in this expression, 


|z 


» 
“ 


<| 


~ 
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length 
M 


angle of @ radians 


FIGURE 3 


THEOREM 2 


PROOF 


so that z/|z| 1s a complex number of absolute value 1. Now any complex number 
. : 2) cy . . . 
a=x+iy with | = |a| =x + y* can be written im the form 


a = (cos9,sm@) = cos@ +isin@ 
for some number 6. ‘Thus every nonzero complex number z can be written 
& = r(cos@ £ isin 0) 


for some r > 0 and some number @. ‘The number r is unique (it equals |z|), but 6 
Is not unique; if 9 Is one possibility, then the others are 69 + 2km for k in Z—any 
one of these numbers is called an argument of z. Figure 3 shows z in terms of r 
and 6. (To find an argument 6 for z = x +iy we may note that the equation 


x+iy = z= |z|(cos@ +/ sin @) 
means that 


X =aizieees G 
y =siziisnigs 
So, for example, if x > 0 we can take 6 = arctan y/x; if x = 0, we can take 
6.= 76.2 Wheng >'Uduae = 37/2 when y <0) 
Now the product of two nonzero complex numbcrs 


z=r(cosé+isin8@), 
w = s(cos@ +isin®@), 


1S 


rs(cos@ +7 sin 6)(cos @ + ising) 
= rs|(cos@ cos @ — sin @ sin d) + i(sin 6 cos@ + cos O sin )| 
= rs|cos(@+@) +ism(6 + ¢)]. 


*wWw 


N 


Thus, the absolute value of a product is the product of the absolute values of the 
factors, while the sum of any argument for each of the factors will be an argument 
for the product. kor a nonzero complex number 


z=r(cosé +isin@) 
it is now an easy matter to prove by induction the following very important formula 
(sometimes known as De Moivre’s Theorem): 


z" = |z|"(cosu@ +isinn@), for any argument 0 of <. 


=i) 


This formula describes 2” so explicitly that it is easy to decide just when z” = w: 


Every nonzero complex number has exactly n complex mth roots. 
More precisely, for any complex number w 4 0, and any natural number 1, 
there are precisely 1 different complex numbers z satisfying 2” = w. 


Bet 
w= s(cosd+tisnd) 


FIGURE 4 
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for s = |w| and some number ¢. Then a complex number 
z=r(cos@+/sin@) 
satisfies 2” = w if and only if 
r"(cosn@ +isinn@) = s(cos@ +i sing), 
which happens if and only if 


p= 7s 


cosn@ +isinnd =cosd@+isn}g. 


From the first equation it follows that 


where V/s denotes the positive real nth root of s. From the second equation it 
follows that for some integer k we have 


oO. 2k 
6=4 = —+— 
H n 
Conversely, if we choose r = ‘/s and 6 = & for some k, then the number z = 


r(cos@ +7 sin@) will satisfy 2” = w. To determine the number of nth roots of w, 
it is therefore only necessary to determine which such z are distinct. Now any 
integer k can be written 


k=ngt+k 
for some integer g, and some integer k’ between 0 and n — 1. Then 
cos& +i sm = cos & +7 sin. 
This shows that every z satisfying z” = w can be written 
z= "/s(cos& +isin®) k=O0,...,7—1. 


Moreover, it is easy to see that these numbers are all different, since any two & for 
k=0,...,n —1 differ by less than 27. J 


In the course of proving Theorem 2, we have actually developed a method for 
finding the nth roots of a complex number. For example, to find the cube roots 
of i (Figure 4) note that |/| = | and that 2/2 is an argument for 7. The cube roots 
of i are therefore 


| TE oa ua 
[cos & + i sin 61° 


ek ec ma = os 52 
3 isin = cos +i sin 6" 
1 


6 
6 
4 Reyes, 4a = OF ‘§. Sx. 
+ +7 sil 6° SOS ae we gs: 


- 
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Since 


IT V3 _ oI l 
cos — = —, sin — = -, 
2 2 
Sie 3 Si | 
05 —— = —- —, i 
Ene 6 2 Gag 
bind 0 Sar 
SOsa5. = : Say a 


the cube roots of 7 are 


eee es 
ay 7s? 


—i. 
2 


In general, we cannot expect to obtain such simple results. For example, to find 


the cube roots of 2+ 11, note that [2 + 11i] = ¥22 + 112 = V125 and that 


arctan 4 is an arguinent for 2+ 11/. One of the cube roots of 2+ 117 is therefore 


r arctan et foe arctan i 
125 | cos | ————_] +i sm [| ————— 
3 3 
arctan a ae arctan ” 
Bi 5 cos | ——— __ ] +7 sm | ————— 


2) 3 


Previously we noted that 2 +i is also a cube root of 2+ Ili. Since |2 +7] = 
V2? +12 = V5, and since arctan 5 is an argument of 2 +7, we can write this 
cube root as 

a = V5(cos arctan 4 + 7 sin arctan 5). 


These two cube roots are actually the same number, because 


arctan Ls | 
SS SS C= 
& 2 


vou can check this by using the formula in Problem 15-9), but this is hardly the 
y ; S ) 


sort of thing one might notice! 

The fact that every complex number has an wth root for all 1 ts just a special 
case of a very important theorem. The number i was originally introduced in 
order to provide a solution for the equation x7 + | = 0. The Fundamental Theorem 
of Algebra states the remarkable fact that this one addition automatically provides 
solutions for all other polynomial equations: every equation 


2g ered | at ap — 0 aoe. = a, 1 Line 


has a coniplex root! 

In the next chapter we shall give an almost complete proof of the Fundamental 
Theorem of Algebra; the slight gap left in the text can be filled m as an exercise 
(Problem 26-5). ‘The proof of the theorem will rely on several new concepts which 
come up quite naturally in a more thorough mvestigation of complex numbers. 
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PROBLEMS 


I 


*8, 


Find the absolute value and argument(s) of each of the following. 


(i) 344i. 
ji) (3442)7!. 
Gi ee). 
(iv) Yea, 

( 


vy) |[3+4i|. 
Solve the following equations. 


(i) “x? +ix 41=0) 

Gi) xt+x74+1=0. 

(iii) x? +2ix-—1=0. 

ip | Seo, 
(2 pea 

(Vile = too lO) 


Describe the set of all complex numbers z such that 
5 —1 
z-—al=(|z—D|. 


| 
wv) |z-—al+|z—bl=c. 
[z| < 1 — real part of z. 


Prove that |z| = |Z|, and that the real part of z ts (¢+2)/2, while the imaginary 
pants (¢ = z)/2. 


Prove that |z + wl? + |z — w/? = 2(|<|? + |w/?), and interpret this statement 
geometrically. 


What is the pictorial relation between z and Vi -zJ/=i? (Note that there 
may be more than one answer, because Vi and V—i both have two different 
possible values.) Hint: Which line goes into the real axis under multiplication 


by ¥-i? 


(a) Prove that if ag, ... , @—1 are real and a + bi (for a and b real) satisfies 
the equation z” + Gy-1z"~ 1 +--+ + ag = 0, then a — bi also satisfies this 
equation. (Thus the nonreal roots of such an equation always occur in 
pairs, and the number of such roots is even.) 

(b) Conclude that z” +a,_)Z"~! +---+ap9 is divisible by Sa Ge) 
(whose cocfhicients are real). 


(a) Let c be an integer which is not the square of another integer. If a and b 
are integers we define the conjugate of a + bvc, denoted by a + bv. 
as a — b/c. Show that the conjugate is well defined by showing that a 
number can be written a + b Jc, for integers a and b, in only one wav. 
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*10. 


a eB 


+12. 


(b) 


(c) 


Show that for all a and f of the form a+b /c, we have a =a; & =a if 
and only if @ is an integer; a+ B =a + Bp; -a = -@:a-B=a- B; and 
a! =(a)-' if a £0. 

Prove that if ao, ..., G,—-1 are integers and z = a+ bJ/c satisfies the 


equation z” + Gray ape 0, then Zz = a — bV© also satisfies 
this equation. 


Find all the 4th roots of 7; express the one having smallest argument in a 


form that does not involve any trigonometric functions. 


(a) 
(b) 


Prove that if @ is an ath root of 1, then so is w. 

A number @ is called a primitive nth root of | if {1,@.@*,...,@"~'} 
is the set of all nth roots of 1. How many primitive nth roots of | are 
therevor w= 394,°5, 9? 


i= 
Let w be an nth root of 1, with w 4 1. Prove that ya = (0) 
k=0 
Prove that if 21, ... , 2x lie on one side of some straight ine through 0, 


then z) +--+: +2, #0. Hint: This is obvious from the geometric inter- 
pretation of addition, but an analytic proof is also easy: the assertion is 
clear if the line is the real axis, and a trick will reduce the general case 
to this one. 


(b) Show further that zy7!, .-- > Zk all lie on one side of a straight line 
through 0, so that Ze a eta 
Prove that if |z;| = |zo| = |z3| and z| + go + e3 = 0, then z), £2, and z3 are 


the vertices of an equilateral triangle. Hint: It will help to assume that z, 1s 
real, and this can be done with no loss of generality. Why? 


CHAPTER 


COMPLEX FUNCTIONS 


You will probably not be surprised to learn that a deeper investigation of complex 
numbers depends on the notion of functions. Until now a function was (intuitively) 
a rule which assigned real numbers to certain other real numbers. But there is no 
reason why this concept should not be extended; we might just as well consider a 
rule which assigns complex numbers to certain other complex numbers. A rigorous 
definition presents no problems (we will not even accord it the full honors of a 
formal definition): a function is a collection of pairs of complex numbers which 
does not contain two distinct pairs with the same first element. Since we consider 
real numbers to be certain complex numbers, the old definition is really a special 
case of the new one. Nevertheless, we will sometimes resort to special terminology 
in order to clarify the context in which a function is being considered. A function 
f is called real-valued if f(z) is a real number for all z in the domain of f, and 
complex-valued to emphasize that it is not necessarily real-valued. Similarly, 
we will usually state explicitly that a function f is defined on [a subset of] R in 
those cases where the domain of f is [a subset of] R; in other cases we sometimes 
mention that f is defined on [a subset of] G to emphasize that f(z) is defined for 
complex z as well as real z. 

Among the multitude of functions defined on C, certain ones are particularly 
important. Foremost among these are the functions of the form 


: : —| 
fe) "Ge et One ee ae 


where ag, ... , @, are complex numbers. These functions are called, as in the 
real case, polynomial functions; they include the function f(z) = z (the “identity 
function”) and functions of the form f(z) =a for some complex number a (“con- 
stant functions”). Another important generalization of a familiar function is the 
“absolute value function” f(z) = |z| for all z in C. 

‘Two functions of particular importance for complex numbers are Re (the “real 
part function’) and Im (the “imaginary part function”), defined by 


Ree 7)) =x, 4 

for x and y real. 
Im(x +iy) = y, 

The “conjugate function” is defined by 


of (2) =z =sRe(z) — 1 Imi(z). 


Familiar real-valued functions defined on R may be combined in many ways to 
produce new complex-valued functions defined on Can example is the function 


: ; ont 8 
f(x +iy) =e*sm(x — y) +ix> cosy. 


541 
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The formula for this particular function illustrates a decomposition which is always 
possible. Any complex-valued function f can be written in the form 


f =utiv 


for some real-valued functions u and v—simply define u(z) as the real part of f(z), 
and v(z) as the imaginary part. ‘This decomposition is often very useful, but not 
always; for example, it would be inconvenient to describe a polynomial function 
in this way. 

One other function will play an important role in this chapter. Recall that an 
argument of a nonzero complex number z is a (real) number @ such that 


z = |z|(cos@ +/sin@). 


There are infinitely many arguments for z, but just one which satisfies 0 < 6 < 
2m. If we call this unique argument 6(z), then @ is a (real-valued) function (the 
“arguinent function”) on {z in G: 2 4 O}. 

“Graphs” of complex-valued functions defined on C, since they he in 4-dimen- 
sional space, are presumably not very useful for visualization. ‘The alternative 
picture of a function mentioned in Chapter 4 can be used instead: we draw two 
copies of C, and arrows from z in one copy, to f(z) in the other (Figure 1). 


FIGURE 1 


The most common pictorial representation of a complex-valued function 1s pro- 
duced by labeling a point in the plane with the value f(z), imstead of with z (which 
can be estimated from the position of the pomt in the picture). Figure 2 shows this 
sort of picture for several different functions. Certain features of the function are 
illustrated very clearly by such a “graph.” For example, the absolute value function 
is constant on concentric circles around QO, the functions Re and Im are constant 
on the vertical and horizontal lines, respectively, and the function f(z) = 2? wraps 
the circle of radius r twice around the circle of radius r?. 

Despite the problems involved in visualizing complex-valued functions m gen- 
eral, it is still possible to define analogues of important properties previously defined 
for real-valued functions on R, and im some cases these properties may be easier 
to visualize in the complex case. For example, the notion of limit can be defined 


as follows: 


lim f(z) =/ means that for every (real) number ¢ > 0 there ts a (real) number 
Comeate} 


5 > 0 such that, for all, if O < |z—a| <4, then | f(z) —#| <e. 
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THEOREM 1 


PROOF 


Although the definition reads precisely as before, the interpretation 1s slightly dif- 

ferent. Since |z — w| is the distance between the complex numbers z and w, the 

equation lim f(z) = / means that the values of f(z) can be made to lie inside 
Cem at et 


any given circle around /, provided that z is restricted to lie inside a sufficiently 
small circle around a. This assertion is particularly easy to visualize using the “two 
copy” picture of a function (Figure 3). 


eT Ee, 


KEG WIRES 3 


Certain facts about limits can be proved exactly as in the real case. In particular, 


ligne ee, 

rim ate | 

lim'2"= a, 

ree 9 
lim[ f(z) + g(z)] = lim f(z) + lim g(z), 
atk Fo ae ri Aad 


lim f(z) - g{z) = lim f(z) - lim g(z), 


| ] 
lim i. rT 
Za g@(s) lim 2(z) 


Abs e(b 


if lim g(z) 4 0. 


‘The essential property of absolute values upon which these results are based is the 
mequality |z + w| < |z| + |w|, and this inequality holds for complex numbers as 
well as for real numbers. ‘These facts already provide quite a few limits, but many 


more can be obtained from the following theorem. 


Let f(z) = u(z) + fv(z) for real-valued functions u and v, and let / = a +7 for 
real numbers @ and B. ‘Then lim f(z) = / if and only if 


lim #(z) =a, 


Fem at 8 | 


limnin(z)) a. 


Zn 


Suppose first that lim f(z) =J/. If ¢ > 0, there is 6 > O such that, for all <, 


L7G 


if0O< 


z—a| <6, then | f(z) —lj < «. 
The second inequality can be written 


[u(s) — a} + i[v(z) — p]| ao 
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or 
[w(z) — a]? + [v(z) — B]? « &?. 


Since u(z) — @ and v(z) — B are both real numbers, their squares are positive; this 
inequality therefore implies that 


[u(z) —a]?<e«7 and [uv(z) —f]* <7, 
which implies that 
lu(z) —a|<e and |v(z) — Bl] <e. 
Since this is true for all ¢ > O, it follows that 


lmwe(Z)—os wand lim v@)/ = Bs: 


Za Za 


Now suppose that these two equations hold. If ¢ > 0, there is a 5 > 0 such that, 
for all z, if O < |z —a| < 6, then 
lu(z) —a| < ; and |v(z) —a| < - 


which imphes that 


| f(z) —L| = |[u(z) — @] + i[v(z) — 6] 


< |u(z) —a@| + |i| - |v(z) — Bl 
€ € 


This proves that lim f(z) = J. | 


In order to apply Theorem | fruitfully, notice that since we already know the 
limit lim z = a, we can conclude that 


2-74 


lim Re(z) = Re(a), 


Za 


lim Im(z) = Im(a). 


La 


A limit like 
lim sin(Re(z)) = sin(Re(a)) 


Za 


follows easily, using continuity of sin. Many applications of these principles prove 
such limits as the following: 


lim 2a) 
27a 
lim |z| = lal, 
Za 


L 


: coal: eS : ag 3 
lim e’ sinx +ix~ cosy =e’ sina +ia> cosb. 


(x+iy)—>a+bi 


Now that the notion of limit has been extended to complex functions, the notion 
of continuity can also be extended: f is continuous ata if lim f(z) = f(a), and 
za 
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f is continuous if f is conunuous at a for all a in the domain of f. The previous 
work on limits shows that all the following functions are continuous: 


isa Pee 


(Ee =- 
Fs) 


ap POS Se aly. 


a 
Iz, 


5 : ys aes 
f(x t+iy) =e* six 47x Gos y- 


Examples of discontinuous functions are easy to produce, and certain ones come 
up very naturally. One particularly frustrating example is the “argument func- 
tion” #, which is discontinuous at all nonnegative real numbers (see the “graph” 
in Figure 2). By suitably redefining 6 it is possible to change the discontinu- 
ities; for example (Figure 4), if 6’(z) denotes the unique argument of z with 
m/2 < 6'(z) < 52/2, then 6’ is discontinuous at ai for every nonnegative real 
number a. But, no matter how 6 is redefined, some discontinuities will always 
occur. 
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FIGURE 4 fie 


The discontinuity of @ has an important bearing on the problem of dehning a 
“square-root funcuon,” that is, a function f such that (f(2))? =z forall z. Vor real 
numbers the function “had as domain only the nonnegative real numbers. If 
complex numbers are allowed, then every number has two square roots (except 0, 
which has only one). Although this situation may seem better, it is IN some ways 
worse; since the square roots of z are complex numbers, there is no clear criterion 


for selecting one root to be f(z), m preference to the other. 


FIGURE 5 


[a,b] x [c,d] 


b 


26. Complex Functions 547 


One way to define f is the following. We set f(O) = 0, and for z 4 0 we set 


Ge M(Z 
f(2) = Viel (cos is isin), 


= = 


Clearly (f (z))* = <, but the function f is discontinuous, since @ is discontinuous. 
As a matter of fact, it is impossible to find a continuous f such that (f(z))* = < for 
all z. In fact, it is even unpossible for f(z) to be defined for all z with |z| = 1. To 
prove this by contradiction, we can assume that f(1) = | (since we could always 
replace f by —f). Then we claim that for all @ with 0 < 6 < 27 we have 


wml Dd 


0 ; 
() f(cos6 +7 sin@) = cos . + isin 


The argument for this is left to you (it is a standard type of least upper bound 
argument). But (*) implies that 


lim f(cos@+isin@) = cosmx +isinz 
(Daa 
— =| 


# f(1), 


even though cos@ +isin@d — | as 6 — 2z. Thus, we have our contradic- 
tion. A similar argument shows that it is impossible to define continuous “wth-root 
functions” for any n > 2. 

kor continuous complex functions there are important analogues of certain the- 
orems which describe the behavior of real-valued functions on closed intervals. A 
natural analogue of the interval [a@, b] is the set of all complex numbers z = x +/y 
with a < x < band c < y <d (Figure 5). This set is called a closed rectangle, 
and is denoted by [a, b] x [c. d]. 

If f is a continuous complex-valued function whose domam is [a,b] x [c,d], 
then it seems reasonable, and is indeed true, that f is bounded on [a, b] x [c, d]. 
That is, there is some real number M such that 


[f@| <M ™ toralle mm fay (coal: 


It does not make sense to say that f has a maximum and a minimum value on 
[a,b] x [c,d]. since there is no notion of order for complex numbers. If f is a 
real-valued function, however, then this assertion does make sense, and is true. In 
particular, if f is any complex-valued continuous function on [a,b] x [c,d]. then 
| f| is also continuous, so there is some zg in [a, b] x [c,d] such that 


Lf odd (e)| for alle in fia, b] x [e. d]; 


a similar statement is true with the mequality reversed. It is sometimes satd that 
“f attains its maximum and minnmum modulus on [a,b] x [e.d].” 

The various facts listed in the previous paragraph will not be proved here, al- 
though proofs are outImed in Problem 5. Assuming these facts, however, we can 
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THEOREM 2 (THE FUNDAMENTAL 
THEOREM OF ALGEBRA) 


PROOF 


now give a proof of the Fundamental ‘Theorem of Algebra, which is really quite 
surprising, since we have not yet said much to distinguish polynomial functions 
from other continuous functions. 


Let ao.....@,—-, be any complex numbers. ‘Then there is a complex number z 
such that 


= =49) 
7 oleae pop el peg a ME el ag = 0. 


Let 
f Ox a eee 


Then f is continuous, and so is the function | f| defined by 


1 


PCS Mp 8 4)) se ee Be eo ri, 


Our proof is based on the observation that a point zo with f (zo) = 0 would clearly 
be a mimimum point for | f|. ‘Lo prove the theorem we will first show that | f| does 
indeed have a smallest value on the whole complex plane. ‘Vhe proof will be almost 
identical to the proof, in Chapter 7, that a polynomial function of even degree 
(with real coefficients) has a smallest value on all of R; both proofs depend on the 
fact that if [z| is large, then | f(z)| ts large. 

We begin by writing, for z 4 0, 


An a 
= (: $e BY 


~ a” 


so that 


I f(z)| = II" - | if 


Let 
M =. maxi e213 |a,,—9||9. «- a 2ealapl) 


Then for all z with |z| > M, we have |z*| > |z| and 


lan—x| 2 lane = lQn—x| = | 
el =" el 2alaescl | 2a 
a) 
ay 4 ay By do l 
4 a A a |e 
s 5 || = Z +| || oe oT 
which implies that 
an-| do dn-] ay | 
i+ —~ aligele elles) Pea te Kg i aie 


This means that n 


Pole wx Fon |Z hoe 


a 


In particular, if |z| => M and also |c| => ¥2|f(0)|, then 
[f= 1FO). 
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Now let [a. 6] x [c,d] be a closed rectangle (Figure 6) which contains {z : |z| < 
max(M, V2] f (0)| Me and suppose that the minimum of |f| on [a,b] x [c,d] is 
attained at zg, so that 


Cal oleae for zim [a,b] x [c,d]. 
It follows, in particular, that | f(zo)| < |f(O)|. Thus 
(2) if |z| > max(M, ¥2/f(0)|), then | f(2)| = |fO)| = Ifo). 


Combining (1) and (2) we see that | f(zo)| < | f(<)| for all z, so that | f| attains its 
minimum value on the whole complex plane at zo. 


max(M, V2] f(0)| ) 


If(z)| = 1 FO)! 
for z here 
FIGURE 6 
‘lo complete the proof of the theorem we now show that f(zo) = 0. It is 


convenient to introduce the function g defined by 
g(z) = f(z + 20). 


Then g is a polynomial function of degree n, whose mintmum absolute value 
occurs at 0. We want to show that g(0) = 0. 

Suppose instead that g(0) = a 4 0. If m is the smallest positive power of z 
which occurs in the expression for g, we can write 


2(z) =v + Bz” eke oie + ¢,2", 


where B 4 0. Now, according to Theorem 25-2 there is a complex number y 
such that 
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‘Then, setting dy = cx y*, we have 


le(vz)| = lot By" 2” + dinaiz™! +--+ d,2" 


— 77) | 
= ja —a2” + dyy 2" +e: | 


w ( — zm 4 a | +) | 


ber 
(ie se [ter J) 
Ol 
a, 
jaf ot pm | Set gn. 


‘This expression, so tortuously arrived at, will enable us to reach a quick contra- 


diction. Notice first that if |z| is chosen small enough, we will have 


din+1 o 
a ~ 


= il. 


If we choose, from among all z for which this inequality holds, some z which is real 
and posite, then 


= din+| a... e \2”"| ait 
a 
Consequently, if 0 < z < | we have 
re ee || et 
J— 2p | et | |b — 27] tie" | ete 
a a 
=1-24|2"| FH +. | 
a 


This is the desired contradiction: for such a number z we have 


3 


le(vz)| < la 


contradicting the fact that |@| is the minimum of |g| on the whole plane. Hence, 
the original assumption must be incorrect, and g(0) = 0. This implies, finally, that 


f(%) =0. ff 


Even taking into account our omission of the proofs for the basic facts about 
continuous complex functions, this proof verified a deep fact with surprisingly 
little work. It is only natural to hope that other mteresting developments will arise 
if we pursue further the analogues of properties of real functions. “Che next obvious 
step 1s to define derivatives: a function f is differentiable at a if 


. fl(a+z)—- fla) 
hm ee 


exists, 
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in which case the limit is denoted by f’(a). It is easy to prove that 


f(a) =0 if f(z) Se 

flay=1 if f(2) =z, 
(f + 8)'(a) = f(a) + 8'(a), 

(f <8) (a) = f'(a)ga) + flayg'(a). 
l / a, 
(..) (a) = aS if g(a) 4 0. 
(f og)(a) = f'(g(a))- 8'(a): 

the proofs of all these formulas are exactly the same as before. It follows, in 
particular, that if f(z) = 2", then f’(z) = ”z"7!. These formulas only prove the 
differentiability of rational functions however. Many other obvious candidates are 
not differentiable. Suppose, for example, that 


Gai) ) = Nome Yoro(.€., of (z) = £). 
If f is to be differentiable at 0, then the limit 


| f(x +iy) -— f(O) 
im = ——————— = _ lim ; 
(xtiy)0 et)! (xt+iy)>0 X +1Yy 


x—ly 


must exist. Notice however, that 


; i— 
it y — Of'then — =|, 
XP ey, 


and 


= oat 
it 4 — 0, then —=-—]; 
Xa ee 


therefore this limit cannot possibly exist, since the quotient has both the values | 
and —1 for x + iy arbitrarily close to 0. 

In view of this example, it is not at all clear where other differentiable functions 
are to come from. If you recall the definitions of sin and exp, you will see that 
there is no hope at all of generalizing these definitions to complex numbers. -\t 
the moment the outlook is bleak, but all our problems will soon be solved. 


PROBLEMS 


1. (a) For any real number y, define a(x) = x +/y (so that @ Is a complex- 
valued function defined on R). Show that @ is continuous. (This follows 
immediately from a theorem in this chapter.) Show similarly that 6(y) = 
x +/7y is continuous. 

(b) Let f be a continuous function defined on C. For fixed y, let giv) = 
f(x +iy). Show that g is a continuous function (defined on Rj. Show 
similarly that h(y) = f(x +/y) 1s continuous. Hint: Use part (a). 


2. (a) Suppose that f is a continuous real-valued function defined on a closed 
rectangle [a, b| x[c,d]. Prove that if f takes on the values f(z) aud f(w) 
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for z and w in [a, b} x [c,d], then f also takes all values between f(z) 
and f(w). Hint: Consider g(t) = f(tz + (1 — t)w) for t in [0, 1]. 

*(b) If f is a continuous complex-valued function defined on [a, b] x [c,d], 
the assertion in part (a) no longer makes any sense, since we cannot talk 
of complex numbers between f(z) and f(w). We might conjecture that 
f takes on all values on the line segment between f(z) and f(w), but 
even this is false. Find an example which shows this. 


3. (a) Prove that if ag, ..., @,-) are any complex numbers, then there are 
complex numbers Z1, ... , Zn (not necessarily distinct) such that 


A a ll | [« — z). 
i=l 
(b) Prove that if ap, ... , @,-; are real, then z" +a,_-1z"-! +--+ 4+ ap can be 
written as a product of linear factors z+a and quadratic factors z*-+az+b 
all of whose coefficients are real. (Use Problem 25-7.) 


4. In this problem we will consider only polynomials with real coefficients. Such 
Hee aan : a) B) 
a polynomial is called a sum of squares if it can be written as hy-+---+h,° 

for polynomials f; with real coefficients. 


(a) Prove that if f is a sum of squares, then f(x) > O for all x. 
(b) Prove that if f and g are sums of squares, then so is f : g. 
(c) Suppose that f(x) > 0 for all x. Show that f is a sum of squares. Hint: 


First write f(x) = Te — aj)* *9(x), where g(x) > 0 for all x. Then use 


i=] 


Problem 3(b). 


5. (a) Let A be a set of complex numbers. A number z is called, as in the 
(a) real case, a limit point of the set A if for every (real) ¢ > 0, there 1s 
a point a in A with |z —a| < € but < 4a. Prove the two-dimensional 
version of the Bolzano-Weierstrass ‘Theorem: If A is an infinite subset 
of [a,b] x [c,d], then A has a hmit point in [a,b] x [c,d]. Hint: First 
divide [a,b] x [c,d] in half by a vertical line as in Figure 7(a). Since A 
is infinite, at least one half contains mfinitely many pomts of A. Divide 
(b) this m half by a horizontal line, as in Figure 7(b). Gontanue in this way, 
alternately dividing by vertical and horizontal lines. 


FIGURE 7 
(The two-dimensional bisection argument outlined in this hint 1s so stan- 
dard that the title “Bolzano-Weierstrass” often serves to describe the 
method of proof, in addition to the theorem itself. See, for example, 
H. Petard, “A Contribution to the Mathematical ‘Theory of Big Game 
Hunting,” Amer ALath. Monthly, 45 (1938), 446 447.) 

(b) Prove that a continuous (complex-valued) function on [a,b] x [c¢, d] 1s 
bounded on [a,b] x [c,d]. (Imitate Problem 22-31.) 

(c) Prove that if f is a real-valued continuous function on [a,b] x [c,d], 
then f takes on a maximum and minimum value on [a,b] x [c,d]. (You 
can use the sanie trick that works for ‘Theorem 7-3.) 


(a) a convex subset of the plane 


(b) a nonconvex subset of the plane 


LOG CTR TB, te! 
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*6. ‘The proof of Theorem 2 cannot be considered to be completely elementary 
because the possibility of choosing y with y” = —a/f depends on Theo- 


rem 25-2, and thus on the trigonometric functions. It is therefore of some 


interest to provide an clementary proof that there is a solution for the equa- 
Rio 24 =e 0, 


(a) 
(b) 


(c) 


7a Let 


Make an explicit computation to show that solutions of <7 — ¢ = 0 can 
be found for any complex number c. 

Explain why the solution of <” —c = 0 can be reduced to the case where 
nis odd. 


Let zp be the point where the function f(z) = 2” 


—c has its minimum 
absolute value. If zo 4 0, show that the integer m in the proof of Theo- 
rem 2 is equal to 1; since we can certainly find y with y! = —w/B, the 
remainder of the proof works for f. It therefore suffices to show that the 
minimum absolute value of f does not occur at 0. 

Suppose instead that f has its minimum absolute value at 0. Since 77 is 
odd, the points +6, +di go under f into —c+6", —c+6"7. Show that for 
small 5 at least one of these points has smaller absolute value than —c, 
thereby obtaming a contradiction. 


Wig 1) +... - (27 — 2)” for wi, ... mix > 0. 
k 
slotinar / (Zz) = (z—z))" =... (2 3 a > male =A) 
a=] 
k 
ate et2). = Yo malz — ee Show. that if ¢(Ge——e@ shen airs: 
a=| 


cannot all lic on the same side of a straight line through z. Hint: Use 
Problem 25-11. 

A subset K of the plane is convex if K contains the line segment joming 
any two points in it (Figure 8). For any set A, there is a smallest convex 
set containing it, which is called the convex hull of A (Figure 9); ifa 
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8. 
A), 


10. 


point P is not in the convex hull of A, then all of A is contained on one 
side of some straight line through P. Using this information, prove that 
the roots of f’(z) = 0 le within the convex hull of the set {z),..., Zk}. 
Further information on convex sets will be found in reference [18] of the 
Suggested Reading. 


Prove that if f is differentiable at z, then f is continuous at z. 


Suppose that f = u + iv where u and v are real-valued functions. 


For fixed yo let g(x) = u(x + iyo) and h(x) = v(x + iyo). Show that if 
f'(xo t iyo) =a + if for real a and B, then g’(x9) = @ and h’(xo) = B. 
On the other hand, suppose that k(y) = u(xgp+iy) and /(y) = v(xo+iy). 
Show that /'(yo) = @ and k’(yo) = —f. 

Suppose that f’(z) = 0 for all z. Show that f is a constant function. 


Using the expression 


Gye p) l ( | | ) 
Aan REE ESC at A trey 
find f(x) for all k. 
Use this result to find arctan“) (0) for all k. 


CHAPTER COMPLEX POWER SERIES 


If you have not already guessed where differentiable complex functions are gomg 
to come from, the title of this chapter should give the secret away: we intend to 
define functions by means of infinite series. This will necessitate a discussion of 
infinite sequences of complex numbers, and sums of such sequences, but (as was 
the case with limits and continuity) the basic definitions are almost exactly the 
same as for real sequences and series. 

An infinite sequence of complex numbers is, formally, a complex-valued func- 
tion whose domain is N; the convenient subscript notation for sequences of real 
numbers will also be used for sequences of complex numbers. A sequence {a,} of 
complex numbers is most conveniently pictured by labeling the points a, in the 
nue cel plane (Figure 1). 


The sequence shown in Figure | converges to 0, “convergence” of complex 
sequences being defined precisely as for real sequences: the sequence {ay} 
converges to /, in symbols 


ais im 4 ie 
a2 ly os oes : : 
"a, awaitoay if for every € > O there is a natural number N such that, for all n, 
La e 
a4 3 ap 
are ee ifn > N, then la, —1| <. 
5 a6 


This condition means that any circle drawn around / will contain a, for all suff- 
ciently large n (Figure 2); expressed more colloquially, the sequence is eventually 
inside any circle drawn around /. 


Convergence of complex sequences 1s not only defined precisely as for real 
FIGURE 2 sequences, but can even be reduced to this familiar case. 
THEOREM 1 _ Let 
a, — Ul, ic, for real D, and ic, 
and let 
l=Bt+iy for real B and y. 


Then lim a, = / if and only if 


n—>0o 
lm by = 6 and litixC) p= 
n— oo n—> Co 
PROOF — ‘The proof is left as an easy exercise. If there 1s any doubt as to how to proceed, 


consult the similar Theorem | of Chapter 26. J 


The sum of a sequence {a,} is defined, once again, as lim s,, where 
NCO 


Sp HO ap o°° Se @ine 
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THEOREM 2 


PROOF 


THEOREM 3 


PROOF 


Sequences for which this limit exists are summable; alternatively, we may say that 


the mfinite series ) a, converges if this mit exists, and diverges otherwise. It 
hall 

is unnecessary to develop any new tests for convergence of infinite series, because 

of the followmg theorem. 


Let 
Oy Oper Gh fon Taal Devan e,. 
Then a converges if and only if Se, and ee c, both converge, and in this 
n=] n=l ill 

case 

OO OO (e.@) 

ee (one) 

n=] n=] n=] 


This ts an mmediate consequence of Theorem | applied to the sequence of partial 
sums of {an}. ff 


There is also a notion of absolute convergence for complex series: the series 


) a, converges absolutely if the series ) |a,| converges (this is a series of real 


n=1 n=| 
numbers, and consequently one to which our earlier tests may be apphed). The 


following theorem ts not quite so easy as the preceding two. 
ig y | = 


Jef 
a, = b,, tic, fer realy, anda, 
we od) fos) 
‘Then Daa. converges absolutely if and only if a and eG, both converge 
n=| n=] n=] 
absolutely, 


Suppose first that Deus and c, both converge absolutely, 1e., that De |b, | and 


n=] II n=1 
CO OO 
c,| both converge. It follows that b,| + |e, | converges. Now, 
(2) 5 
n=l i 
lan | >= Ibn ar 1CH| = Ibn | ole (Cale 
foe) 


It follows from the comparison test that ) la,| converges (the numbers |a,| and 


n=] 
oo 


lbn| + len| are real and nonnegative). “Thus ) a, converges absolutely. 


n=l 
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ie, 2) 
Now suppose that ) lan| converges. Since 


n=l 


lap (t= Vv Dp Ec, 


it is clear that 
lo, = la, sand le,| = laa. 
[o.@) lo @) 
Once again, the comparison test shows that SS |b, | and Se lcn| converge. J 


n=1| n=1 


lo. 2) 
‘Two consequences of Theorem 3 are particularly noteworthy. If ) An CON- 


n=1 
lo @) lo.) 


verges absolutely, then ae and ee also converge absolutely; consequently 


n=l n=l 


oe b, and SS c, converge, by Theorem 23-5, so 5 a, converges by ‘Theorem 2. 
n=l n=] n=1 
In other words, absolute convergence implies convergence. Similar reasoning 
shows that any rearrangement of an absolutely convergent series has the same 
sum. These facts can also be proved directly, without using the corresponding the- 
orems for real numbers, by first establishing an analogue of the Cauchy criterion 
(see Problem 13). 

With these preliminaries safely disposed of, we can now consider complex 
power series, that is, functions of the form 


f(z) = BAC = @) a aot ag) ON a el) 
n=0 


Here the numbers a and a, are allowed to be complex, and we are naturally 
interested in the behavior of f for complex z. As in the real case, we shall usually 
consider power series centered at 0, 


a= a 


n=0 


in this case, if f (zo) converges, then f(z) will also converge for |z| < |zo|. The 
proof of this fact will be similar to the proof of Theorem 24-6, but, for reasons 
that will soon become clear, we will not use all the paraphernalia of uniform con- 
vergence and the Weierstrass M-test, even though they have complex analogues. 
Our next theorem consequently generalizes only a small part of Theorem 24-6. 


Suppose that 
le, 2) 


; 
>| anc" = ag + a1z0 + acy” +++ 
n=O) 
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FIGURE 3 


converges for some zo 4 0. ‘Then if |z| < |zo|, the two series 


lo @) 
Ds 
Phan ied = @9 42 oe ae 
n=0 


OO 
= , 
) nane™ | = ay + 2anz + 30327 + --- 


ill 


both converge absolutely. 


As in the proof of Theorem 24-6, we will need only the fact that the set of numbers 


an,zo" 1s bounded: there is a number M such that 


lanzo’| < M for all n. 
We then have 
~ n 
A =, Dh = 
(ene Go| ies 
«0 
yn 
afar | 2! 
Z0 
and, for z 0; 
] ™ i 
lV - i a 
hayz | = —nlanzo'|-} — 
Iz| Z0 
M a n 
se — 9 le. 
Zea] 20 
Since the series z/zo|" and n|z/zo|" converge, this shows that both Gyz 
0 so, 1 
n=0 n=] n=0 
[o,@) [o.@) 
and ) nagr @ converge absolutely (the argument for ) NanZ | assumed that 
n=1 n=1 


z #0, but this series certainly converges for z = 0 also). 
Theorem 4 evidently restricts greatly the possibilities for the set 


[o,@) 
|: ’ he converges} 
0 


a= 
OO 


For example, the shaded set A im Figure 3 cannot be the set of all z where ) ant: 
n=O 


> 
0/2 


converges, since it contains z, but not the number w satisfying |w| < 

It seems quite unlikely that the set of points where a power series converges 
could be anything except the set of points inside a circle. If we allow “circles of 
radius 0” (when the power series converges only at 0) and “circles of radius 00” 
(when the power series converges at all pots), then this assertion is true (with one 
complication which we will soon mention); the proof requires only ‘Theorem 4 and 
a knack for good organization. 
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For any power series 


CO 
a 2 2 
One dpe alc 1 G22 @1+a3z +-:* 
n=0 


one of the following three possibilities must be true: 


(oe) 
(1) ) Anz" converges only for z = 0. 


pi) 
fore) 


(2) >» a,z" converges absolutely for all z in C. 


n=0 
fo) 


(3) There is a number R > O such that ae converges absolutely if |z| < R 


n=0 
and diverges if |z| > R. (Notice that we do not mention what happens 


when |z| = R.) 


Let 


CO 
— |: nR: ) a,w" converges for some w with |w| = x | 
n=0 


Suppose first that S is unbounded. Then for any complex number z, there ts 


[e,e) 
a number x in S such that |z| < x. By definition of S, this means that ) ae 
n=0 
CO 
converges for some w with |w| = x > |z|. It follows from Theorem 4 that ) aa 
n=0 


converges absolutely. ‘Thus, m this case possibility (2) is true. 
Now suppose that S is bounded, and let R be the least upper bound of S. If 
Oo 


Rk =O} then ane converges only for z = 0, so possibility (1) is true. Suppose, 


n=0 
on the other hand, that R > 0. Then if z is a complex number with |z| < R, there 
[o,@) 


is anumber x m S with |z| < x. Once again, this means that ) d,w" converges 


n=0 
fore) 


for some w with |z| < |w|, so that ) a,z" converges absolutely. Moreover, if 


n=0 
fee) 


Zi tien ) ayz" does not converge, since |z| is not in S. § 
n=0 


The number R which occurs in case (3) 1s called the radius of convergence of 


(o @) 
) a,z". In cases (1) and (2) it is customary to say that the radius of convergence 
n=0 
is" fandoo, respectively "When OPW =< R < co, the cuwele {z = |z| =" R} 1s calléd 
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Oo 


the circle of convergence of ) anz'. If z is outside the circle, then, of course, 
= . n= 

) a,z does not converge, but actually a much stronger statement can be made: 
n=0 


the semarste? z” 


are not even bounded. ‘lo prove this, let w be any number with 
lz| > |w| > R; ifthe terms a,z” were bounded, then the proof of Theorem 4 would 


[o@) 
show that ) d,w" converges, which is false. ‘Thus (Figure 4), inside the circle of 
n=0 2 
convergence the series ) a,z" converges in the best possible way (absolutely) and 
the terms a,z” are not bounded a 


ie 


outside the circle the series diverges in the worst possible way (the terms a,z 
not bounded). 
What happens on the circle of convergence is a much more difficult question. 


are 
circle of 
convergence 
We will not consider that question at all, except to mention that there are power 
series which converge everywhcre on the circle of convergence, power series which 
converge nowhere on the circle of convergence, and power series that do just about 


converges 
absolutely 


anything in between. (See Problem 5.) 


Algebraic manipulations on complex power series ee be justified Just as in the 
OO 


neal casen_ Whuse ifs f(z). = > ant and 2(2) = ae both have radius of 


FIGURE 4 n=0 n=0 
CO 


convergence == K Mthen h(z)"* = Yo (an + b,)z" also has radius of convergence 
> Randh = f +g inside the cifdlt of radius R. Similarly, the Cauchy product 


[o.@) n 


h@) = ) Caio, = ) axby—z, has radius of convergence > R and h = fg 
n=0 k=0 


= 
inside the circle of radius R. And if f(z) = ) dnz" has radius of convergence > 0 
n=0 


(oe) 

and ag # QO, then we can find a power series DF z" with radius of convergence 
n=0 

> 0 which represents |/f inside its circle of convergence. 

But our real goal in this chapter is to produce differentiable functions. We 
therefore want to generalize the result proved for real power series in Chapter 24, 
that a function defined by a power series can be differentiated term-by-term in- 
side the circle of convergence. At this poimt we can no longer imitate the proof of 
Chapter 24, even if we were willing to introduce uniform convergence, because no 
analogue of Theorem 24-3 seems available. Instead we will use a direct argument 
(which could also have been used in Chapter 24). Before begining the proof, 


we notice that at least there is no problem about the convergence of the series 


produced by term-by-term differentiation. If the series Ss dyz" has radius of con- 
n=0 ee) 

vergence R, then ‘Theorem 4 mnmediately implies that the series 3 nanz" | also 
n=! 

. Moreover, if |z| > R, so that the terms a,z" are unbounded, 


converges 
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lo @) 


then the terms na,z"~! are surely unbounded, so ) aaa does not converge. 


ial 


oO 
This shows that the radius of convergence of ) nanz" | is also exactly R. 


n=] 


If the power series 


[e,@) 
io — hae 
n=0 


has radius of convergence R > O, then f is differentiable at z for all z with |z| < R, 


and 
[e.@) 


Vos tae: 


n=1 


We will use another “e/3 argument.” The fact that the theorem is clearly true for 
polynonual functions suggests writing 


ctih)—e = = aa — = 
n=! n=0 n=] 
foe) N 
(astm? te") (e42)° = 2) 
< ee a i ae eee 
= wes h ath re 
n=0 n=0 
N N 
zt+hyt— 2 
te oh Kt = x sk = ee. 
n=0 n=l 
N oe) 
+ Sparavie: — Ll a 
n=] n=1 


We will show that for any ¢ > 0, each absolute value on the right side can be made 
< €/3 by choosing N sufficiently large and A sufficiently small. This will clearly 
prove the theorem. 

Only the first term in the right side of (*) will present any difficulties. ‘To begin 
with, choose some zo with |z| < |zo| < R; henceforth we will consider only h 
with |z + h| < |zo|. The expression ((z +)” — z”)/h can be written in a more 
convenient way if we remember that 


wn 
n—2 


“ S15! ae 1 


= 5) —_ 
y zi x? oN oo. ak y" 


Applying this to 
lis enka es eS 
h Pe) ae 


“A 


we obtain 
(z = hy" = zn 


; = (eet ae eye 
1 
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Since ; 
l(cthy + eethy? +--+ 271) <nlzol", 


we have 


(Zh) are.) 


An hy ee 


< nan] - |Zo 


(oe) 
But the series S-nlan| . \zo|"—! converges, so if N is sufficiently large, then 


n— 
foe) 


€ 
Dd, Mlanl -Izol"! < 5. 
n=N+1 
This means that 
(eve) N 
(Cah) Z) (Gigi) az) 
DEES arenes = 2 ere 
n=0 n=0 
=. (Gaya =Z) ~ (Ga WE=Zz)) 
= a ae a. Sa ue < on ae 
ae: h 3 h 
n=N+1 n=N+1 
+ E 
< Yi plan|dlzolty = 3" 
n=N+1 
In short, if N is sufficiently large, then 
N 
a — z') ((z +h)" — z") iS 
a 2 ay << 3? 


for all h with |z + h| < |zo|. 


It is easy to deal with the third term on the right side of (+): Since se Raz” 


converges, it follows that if N is sufficiently large, then is 


(o-) N 


) nanz” | — ) naz’ s 


n=1 n=1 


Finally, choosmg an N such that (1) and (2) are true, we note that 


(2) < =. 


(1) es ie) 
1b AGILE ese 91 2h 
n=0 n=1 
N 
since the polynomial function g(z) = Ss dy,z" is certainly differentiable. ‘Therefore 
n=0 
GaGa = Zz E 
(3) So ae) = 3 nage"! <3: 
n=0 n=1 


for sufficiently small h. 


As we have already indicated, (1), (2), and (3) prove the theorem. J 
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Theorem 6 has an obvious corollary: a function represented by a power series 1s 
infinitely differentiable inside the circle of convergence, and the power series is its 
‘Taylor series at 0. It follows, in particular, that f is continuous inside the circle of 
convergence, since a function differentiable at z is continuous at z (Problem 26-8). 

‘The continuity ofa power series inside its circle of convergence helps explain the 
behavior of certain ‘Taylor series obtained for real functions, and gives the promised 
answers to the questions raised at the end of Chapter 24. We have already seen 
that the ‘Taylor series for the function f(z) = 1/(. + a) namely, 


) 
lie? tet 2 +..., 


converges for real z only when |z| < 1, and consequently has radius of conver- 
gence |. It is no accident that the circle of convergence contains the two points 
i and —i at which f is undefined. If this power series converged in a circle of 
radius greater than 1, then (Figure 5) it would represent a function which was 
continuous in that circle, in particular at ¢ and —i. But this is impossible, since it 
equals 1/(1 +z) inside the unit circle, and 1/(1 +z?) does not approach a limit 
as Zs approaches i or —/ from inside the unit circle. 

The use of complex numbers also sheds some light on the strange behavior of 
the ‘Taylor series for the function 


—1/x? , 
. e yw sel 
LO) = | a 
0, i 
Although we have not yet defined e* for complex z, it will presumably be true that 
if y is real and unequal to 0, then 


figy se Oy ee 


The interesting fact about this expression is that it becomes large as y becomes 
small. Thus f will not even be continuous at 0 when defined for complex numbers, 
so it is hardly surprising that it is equal to its Taylor series only for z = 0. 

The method by which we will actually define e* (as well as sin z and cos z) for 
complex z should by now be clear. For real x we know that 


roe 
mx=x-—+—-—:::," 
et 31 SI 
D 
1x x4 
mmr rT 
x2 
See ee 
° ae 
For complex z we therefore define 
od oS 
GS hogy 
ain 64 
COS Zi marl aay a : 
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a cae, . ry 

Then sini) =atc@s z,cos ‘(z)e== sin 7 sand) cxp (z)_ —"exp(z) iby Dieorgm 0: 
Moreover, if we replace z by iz in the series for e*, and make a rearrangement 
of the terms (justified by absolute convergence), something particularly interesting 


happens: 
: a elm iit) ., Gz) Se 
uz = ae 
e*=1+iz+ oT alr 31 A 5) ar 
my feate oie ie 
= Fie a a a” Sr # 
2 od 2 ae: 
= coll he cme laa EN ra , 
sO 
e© = cosz +isinz. 


It is clear from the definitions (1.c., the power series) that 


sin(—z) = — sin z, 
cos(—z) = cos Z, 


so we also have 
tiie 


e * =cosz —isinz. 


ji 


From the equations for e’= and e~* we can derive the formulas 


; (is — ms 
sin z = —————_-., 
yi 
e+e! 
GoOsSzZ — 
9 


The development of complex power series thus places the exponential function at 
the very core of the development of the elementary functions—it reveals a con- 
nection between the trigonometric and exponential functions which was never 
imagined when these functions were first defined, and which could never have 
been discovered without the use of complex numbers. As a by-product of this 
relationship, we obtain a hitherto unsuspected connection between the numbers e 
and z: if in the formula 
e? = cosz+ising 


we take z = 2, we obtain the remarkable result 


eRe < 
2mi/n 3s an nth root of 1.) 


(More generally, e 

With these remarks we will bring to a close our investigation of complex func- 

tions. And yet there are still several basic facts about power series which have not 

been mentioned. ‘Uhus far, we have seldom considered power series centered at a, 
es 


fWH= Y anlz — a)", 


n=0 
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except for a = 0. This omission was adopted partly to simplify the exposition. 
For power series centered at a there are obvious versions of all the theorems in 


this chapter (the proofs require only trivial modifications): there is a number R 
oe) 


(possibly 0 or oo”) such that the series ) a,(z — a)" converges absolutely for z 


n=0 
with |z — a| < R, and has unbounded terms for z with |z — a| > R; moreover, for 


all z with |z — a] < R the function 


CO 
PrX= a,(z — a)" 
n=0 
has derivative 
OO 
fe) SS nan(z —a)"!, 
n=] 


It is less straightforward to investigate the possibility of representing a function 
as a power series centered at b, if it is already written as a power series centered 


irc. ale 


ie, @) 


7 
PR) = ) anlz —a)" 
n=0 
has radius of convergence R, and b is a point with |b — a| < R (Figure 6), then it 
is true that f(z) can also be written as a power series centered at b, 


fo) = So byle = by" 


n=0 


(the numbers b, are necessarily fob) (mee moreover, this series has radius of 
convergence at least R — |b — a| (et may be larger). 

We will not prove the facts mentioned in the previous paragraph, and there are 
several other important facts we shall not prove. For example, if 


2 


CO 
ie) — a,(z —a)" and LZ) — se by(z — by", 
n=0 n=0 


and g(b) = a, then we would expect that f og can be written as a power series 
centered at b. All such facts could be proved now without introducing any basic 
new ideas, but the proofs would not be as easy as the proofs about sums, products 
and reciprocals of power series. ‘The possibility of changing a power series centered 
at a into one centered at b is quite a bit more involved, and the treatment of 
f og requires sul} more skill. Rather than end this section with a four de force 
of computations, we will mstead give a preview of “complex analysis,” one of 
the most beautiful branches of mathematics, where all these facts are derived as 
straightforward consequences of some fundamental results. 

Power series were introduced in this chapter in order to provide complex func- 
tions which are diflerentiable. Since these functions are actually infinitely differ- 
entiable, it is natural to suppose that we have therefore selected only a very special 
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collection of diflerentiable complex functions. ‘The basic theorems of complex 
analysis show that this is not at all true: 


Lf a complex function is defined in some region A of the plane and 1s differentiable in A, 
then ut is automatically infinitely differentiable in A. Moreover, for each point a in A the 
Taylor senes for f at a will converge to f in any circle contained in A (Figure 7). 


‘These facts are among the first to be proved in complex analysis. It 1s impossible 
to give any idea of the proofs themselves— the methods used are quite diflerent 
from anything in elementary calculus. If these facts are granted, however, then 
the facts mentioned before can be proved very easily. 

Suppose, for example, that f and g are functions which can be written as power 
series. Then, as we have shown, f and g are differentiable—it then follows from 
easy general theorems that f + g, f -g, 1/g and f og are also differentiable. 
Appealing to the results from complex analysis, it follows that they can be written 
as power series. 

We already know how to compute the power series for f +g, f-g and 1/g from 
those for f and g. It is also easy to guess how one would compute an expression 
for fog asa power series In (z—b) when we are given the power series expansions 

6) 


uPA, = Sy) ant aa a)" 


n=0 
‘e, @) 
g(z) = ne =p)" 
k=0 
with a = g(b) = bg, so that 


ae 
g(zZ) -—a= AG — b)'. 
k=1 


First of all, we know how to compute the power series 


(g(z) —a)' = (Some — oy) 
k=] 


and this power series will begin with (z — by, Consequently, the coefficient of 2” 
in 


l 


oo 
f(g(z)) = )° a(g(z) — a)! 
1=0 
can be calculated as a finite sum, involving only coefficients arising from the first 7 
powers of g(z) —a. 
Similarly, if 


OO 


Ff () = > anlz = a)" 


n=0 
has radius of convergence R, then f is diflerentiable in the region A = {z : |z—a| < 
R}. ‘Vhus, if b is in A, it ts possible to write f as a power series centered at b, 


FIGURE 8 
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which will converge in the circle of radius R — |b — aj. The coefficient of z” 
will be f(b)/n!. This series may actually converge in a larger circle, because 
CO 


De ale — a)" may be the series for a function differentiable i a larger region 
n=0 
than A. For example, suppose that f(z) = 1/(1 + <7). Then f is differentiable, 


except at 7 and —7, where it is not defined. Thus f(z) can be written as a power 
Be 


series Sia with radius of convergence | (as a matter of fact, we know that 
n=0 
a2, = (—1)" and a, = 0 if k is odd). It is also possible to write 


Ff ) = Te = ae 


n=0 
where b, = f(4)/n!. We can easily predict the radius of convergence of this 
7 yp g 


series: itis V1 + (5), the distance from { to i or —i (Figure 8). 

As an added incentive to investigate complex analysis further, one more result 
will be mentioned, which lies quite near the surface, and which will be found in 
any treatment of the subject. 

For real ¢ the values of sinz always lie between —1 and 1, but for complex z 
this is not at all true. In fact, if < =iy, for y real, then 

= ely) — ey) e-¥ — e@¥ 
Th — F al ee 
If vis large, then sin 7y is also large in absolute value. ‘This behavior of sin is typical 
of functions which are defined and differentiable on the whole complex plane (such 
functions are called entire). A result which comes quite early in complex analysis 1s 
the following: 


Liowville’s Theorem: The only bounded entire functions are the constant functions. 


As a simple application of Liouville’s Theorem, consider a polynomial function 
ee -n—| 
shale coe ee. gees ap 29° SP M9). 


where x > I, so that f is not a constant. We already know that f(z) is large for 
large z, so Liouville’s Theorem tells us nothing interesting about f. But consider 
the function | 


ye @) 

If f(z) were never O, then g would be entire; since f(z) becomes large for large z, 
the function g would also be bounded, contradicting Liouville’s Theorem. Thus 
f(z) = 0 for some z, and we have proved the Fundamental Theorem of Algebra. 


a 


PROBLEMS 


1. Decide whether each of the followmg series converges, and whether it con- 
verges absolutely. 
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4 1+ 2i 
ll 
i . 
n=1 
O° i” 
ill —., 
ii ke 
[o,@) 
jv) YG +5)". 
n=1 
~ log n logn 
7 c O) ie 
Wy) ms n fe ye 


2. Use the ratio test to show that the radius of convergence of each of the 
following power series is 1. (In each case the ratios of successive terms will 
approach a limit < | if |z| < 1, but for |z| > 1 the ratios will tend to 00 or 
to a limit > 1.) 


(ii) So 
n=1 
(iv) Sit 22". 


(v) ys Qn on! 


3. Use the root test (Problem 23-9) to find the radius of convergence of each of 
the followmg power series. (In some cases, you will need limits derived in the 


problems to Chapter 22.) 
AOR An Ss 1G 
(1) rn ee 
1 
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‘The root test can always be used, in theory at least, to find the radius of 
convergence of a power series; in fact, a close analysis of the situation leads 
to a formula for the radius of convergence, known as the “Cauchy-Hadamard 
formula.” Suppose first that the set of numbers ~/Ja,| is bounded. 


lee) 
(a) Use Problem 23-9 to show that if lim %/la,||z| < 1, then eae. con- 
n> OO 


n=0 
verges. 
foe) 
(b) Also show that if lim Y/|a,||z| > 1, then othe has unbounded terms. 
n—>Oo 
n=0 
oO 
(c) Parts (a) and (b) show that the radius of convergence of > om is 
n=0 


1/ lim */Ja,| (where “1/0” means “oo”). To complete the formula, de- 
n—>Oo 


fine lm \/la,| = 00 if the set of all ¥/|a,| is unbounded. Prove that in 


n—©O 
oo 


this case, ) anz" diverges for z 4 0, so that the radius of convergence 


n=0 
is O (which may be considered as “1/00”’). 


Consider the following three series from Problem 2: 


OO yn CO on (ore) 


i = n=] 
Prove that the first series converges everywhere on the unit circle; that the 
third series converges nowhere on the unit circle; and that the second series 
converges for at least one point on the unit circle and diverges for at least 
one point on the unit circle. 


(a) Prove that e* -e” = et” for all complex numbers z and w by showing 


that the infinite series for e**" is the Cauchy product of the series for e 
and”. 

(b) Show that sin(z + w) = sinzcosw + coszsinw and cos(z + w) = 
cos z cos w — sinzsin w for all complex z and w. 


(a) Prove that every complex number of absolute value | can be written e”” 
for some real number y. 
(b) Prove that |e*t'’”| = e* for real x and y. 


(a) Prove that exp takes on every complex value except 0. 
(b) Prove that sin takes on every complex value. 


For each of the following functions, compute the first three nonzero terms of 
the ‘Taylor series centered at 0 by manipulating power series. 


@* .f(@) = tang 
ii) f@=21—27'”. 
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10. 


11. 


(a) 


sin zt __ l 
f(z) =log(1 — 27). 
sin? z 
J 2)=— — 
f= pinta " 
& GOSS 
: ] 
EE Sey ven 


1 [e(VT-D — 1), 

Suppose that we write a differentiable complex function f as f = u + 
iv, where uw and v are real-valued. Let # and v denote the restrictions 
of w and v to the real numbers. In other words, 4#(x) = u(x) for real 
numbers x (but # is not defined for other x). Using Problem 26-9, show 
that for real x we have 


f @=a@) 440), 


where f’ denotes the complex derivative, while a’ and v’ denote the 
ordinary derivatives of these real-valued functions on R. 
Show, more generally, that 


FOR) = a (x) ae iv (x). 
Suppose that / satisfies the equation 
(x) if Qala fp 2 eee ban =O. 


where the a; are real numbers, and where the ee denote higher-order 
complex derivatives. Show that @ and v satisfy the same equation, where 


au and v™ now denote higher-order derivatives of real-valued functions 


on R. 

Show that if a = b+ ci is a complex root of the equation z” +a,—12"~! + 
--» tag = 0, then f(x) = e’* sincx and f(x) = e’* cosex are both 
solutions of (*). 


Show that exp ts not one-one on C. 

Given w # 0, show that e* = w if and only if z = x +iy with x = log |w| 
(here log denotes the real logarithm function), and y an argument of w. 
Show that there does not exist a continuous function log defined for 
nonzero complex numbers, such that exp(log(z)) = z for all z ¥ 0. 
(Show that log cannot even be defined continuously for |z| = 1.) 


Since there is no way to define a continuous logarithm function we can- 
not speak of the logarithm of a complex number, but only of “a logarithm 
for w,” meaning one of the infinitely many numbers ¢ with e* = w. And 


12. 


13. 


14. 


(a) 


(a) 
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for complex numbers a and b we define a? to be a set of complex num- 
bers, namely the set of all numbers e?!°8¢ or, more precisely, the set of 
all numbers e?* where z is a logarithm for a. 


If m is an integer, then a” consists of only one number, the one given by 
the usual elementary definition of a’. 

If m and n are integers, then the set a’”/” coincides with the set of values 
given by the usual elementary definition, namely the set ofall b” where b 
is an mth root of a. 

If a and b are real and b is irrational, then a? 
members, even for a > 0. 

Find all logarithms of 7, and find all values of i‘. 

By (a’)* we mean the set of all numbers of the form z° for some number z 
in the set a? 


contains infinitely many 


. Show that (1')! has infinitely many values, while I" has 


only one. 


b-c 


Show that all values of a? are also values of (a”)°. Is a? = (a?)*N(a‘)”? 


For real x show that we can choose log(x +7) and log(x — /) to be 


log(x +7) =log(V1+x7) +i G — arctan x) 
log(x —j) = log(v 1+ xe) —1 (5 — arctan x) : 


(It will help to note that 2/2 — arctan x = arctan 1/x for x > 0.) 


‘The expression 
L* l I 
b+x2 0 2i\xy-i x+i 


Ix | 
/ Tg = 5, log — 1) — log(x +H), 


Use part (a) to check that this answer agrees with the usual one. 


yields, formally, 


A sequence {a,} of complex numbers is called a Gauchy sequence if 


him! |@..—4,| = OS Suppose that a, — Dea. icm where Bajandic, ane 
mM,R CO 


real. Prove that {a,} 1s a Cauchy sequence if and only if {b,} and {cy} 
are Cauchy sequences. 

Prove that every Cauchy sequence of complex numbers converges. 

Give direct proofs, without using theorems about real series, that an 
absolutely convergent series is convergent and that any rearrangement 
has the same sum. (It is permitted, and in fact advisable, to use the proofs 
of the corresponding theorems for real series.) 


Prove that 


n mes Sin — 
: ee a et l g J 2 git l yx /2 
oe eS go x 

k=I sil = 


2 
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15. 


16. 


i n 
(b) Deduce the formulas for ) coskx and ) smkx that are given in 


k=] k=1 
Problem 15-33. 


hetiiaa bertheFibonacgi sequence, a) = a> = ia,.W — dy. + 4,41. 


(Quinoa — G41 4,,.sa0w that 7,0) = b+ 1/7. 
(b) Show that if r = lim r, exists, then r = 1+1/r, so that r = (1+ J5)/2. 


n> 
(c) Prove that the limit does exist. Hint: If r, < (1 + V5 )/2, then r,2 — 
ie | =O and fe <7 ,45. 


lo, @) 
(d) Show that Diy aya has radius of convergence 2/(1 + V5 ). (Using 


ji 
oe) 


the unproved theorems in this chapter and the fact that ae = 
p= 

—1/ (2° +z— 1) from Problem 24-16 we could have predicted that the 

radius of convergence is the smallest absolute value of the roots of z? + 

z— 1 = 0; since the roots are (—] + V5) /2, the radius of convergence 

should be (—1 + /5) /2. Notice that this number is indeed equal to 


2/(1 + V5).) 


. 7 . . 3) 
Since (e? — 1)/z can be written as the power series 1 + 2/2! + z°/3!+--- 
which is nonzcro at O, it follows that there is a power series 


with nonzero radius of convergence. Using the unproved theorems in this 
chapter, we can even predict the radius of convergence; it is 277, since this is 
the smallest absolute value of the non-zero numbers z = 2kzi for which 
e* — 1 = 0. The numbers b, appearing here are called the Bernoulli 
numbers.* 


(a) Clearly bp = 1. Now show that 


€ z zg e&+1 
mS 2a? ee 
ga tl gael 
a1 a 
and deduce that 
i —5, b,=O0 iit issoddiancdar le 


* Sometimes the numbers By = (—1)"~!'by, are called the Bernoulli numbers, because by = 0 if n 
is odd and > 1 (see part (a)) and because the mumbers 63, alternate in sign, although we will not 
prove this. Other modifications of this nomenclature are also in use. 


Wis 
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(b) By finding the coefficient of z” in the right side of the equation 
(oe) ) 3 
by k he 16 
=| ) jal Jet G+ Rt 


n—1 


n 
> (7) =0 “orn & 
i 


i=0 


show that 


This formula allows us to compute any b; in terms of previous ones, and 
shows that each is rational. Calculate two or three of the following: 


bo =%, br=-3. b= HG. DR =-HH 


6 30° 42 30° 
*(c) Part (a) shows that 
Ys (yl I 
‘ Ope 2 ca) 72 22222 
n= 
Replace z by 2iz and show that 
= 
2n AD) 
Z cot Z — (= 2. 
Ss (2n)! 
n=0 
*(d) Show that 
tan z = cot z — 2 cot 2z. 
*(e) Show that 
CO 
tan = Ss b2n Glyne oO” al 122"! 


(2n)! 


n=l 


(This series converges for |z| < 2/2.) 


The Bernoulli numbers play an important role in a theorem which is best 
introduced by some notational nonsense. Let us use D to denote the “differ- 


entiation operator,” so that Df denotes f’. Then D*f will mean f and 
[o @) 


e? f will mean ) f/n! (of course this series makes no sense in general, 


n=0 
but it will make sense if f is a polynomial function, for example). Finally, 


let A denote the “difference operator” for which Af (x) = f(x + 1) — f(). 
Now Taylor’s Theorem implies, disregarding questions of convergence, that 
[oe 
a) 
(eps 
n=0 
or 
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we may write this symbolically as Af = (e? — 1)f, where 1 stands for the 
“identity operator.” Even more symbolically this can be written A = e? — 1, 
which suggests that 

D 


D = ——A. 
eo | 


Thus we obviously ought to have 


= oe by k 
p= De ae A. 
k=0 


ie. <) 


bi 
(xx) f(x) = a af +1)=— §@)]. 
k=0 


The beautiful thing about all this nonsense is that it works! 


(a) Prove that (#*) is hterally true if f is a polynomial function (in which case 
the infinite sum is really a finite sum). Hint: By applying (*) to f, find 
a formula for f(x +1)— f(x); then use the formula in Problem 16(b) 
to find the coefficient of f% (x) in the right side of (+). 
(b) Deduce from (*) that 
fO+--+fM=> Ap ® = Di 
k=0 


(c) Show that for any polynomial function g we have 
ntl OO hy = 
g(0) +--+» + 9(n) = / giydr+ >> alae ‘in + 1) — g*—-YO)). 
0) 4 
k=] 


(d) Apply this to g(x) = x? to show that 


n—| > 
wet) Eber Ep 
a als p-k+) 
Ds tt,” le 


Ill 


Using the fact that b; = —1, show that 


pt+l Pp 


H nP bye p 
a aon eas pe Welt 
2 pa a ea 


The first ten instances of this formula were written out in Problem 2-7, 
which offered as a challenge the discovery of the general pattern. ‘This 
may now seem to be a preposterous suggestion, but the Bernoulli num- 
bers were actually discovered in precisely this way! After writing out 
these 10 formulas, Bernoulli claims (in his posthumously printed work 
Ars Conjectandi, 1713): “Whoever will examine the series as to their regu- 
larity may be able to continue the table.” He then writes down the above 
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formula, offering no proof at all, merely noting that the coefficients b,x 
(which he denoted simply by A, B, C, ... ) satisfy the equation in Prob- 
lem 16(b). The relation between these numbers and the coefficients in 
the power series for z/(e* — 1) was discovered by Euler. 


*18. ‘The formula in Problem 17(c) can be generalized to the case where g is not a 
polynomial function; the infinite sum must be replaced by a finite sum plus a 
remainder term. In order to find an expression for the remainder, it is useful 
to introduce some new functions. 


(a) ‘The Bernoullt polynomials ~, are defined by 


n 


CD) = » (jonas 


k=0 
The first three are 
Cat x : 
Q(x) =x >? 
(x) =x? —x+ 
Vr SsSxe= x-be: 
Y2 5 
ta) Crees 
93(x) =x — os ar Be 


Show that 


GO). =, 

Gn B, hy 
Qn (x) =, 1 (X)), 

n(x) = (-1)"g, 1 — x). 


Hint: Prove the last equation by induction on n. 
(by leet Ry*(x) be the remainder term in ‘Taylor’s Theorem for f™, on the 
interval [x,x + 1], so that 
N e(k+n) / 
ED) ; 
noe cere) OG) = 0 en), 


n! 
(= 


Prove that 


N N 

/ _ b F ; 

f (x) = S al f( Ger i f@@)] —_ = Re “Ga 
k=0 k=0 

Hint: Imitate Problem 17(a). Notice the subscript N —k on R. 


(c) Use the integral form of the remainder to show that 


he e+] ae 
2b (ee) = / Pe pM at 
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(d) Deduce the “Euler-Maclaurin Summation Formula”: 


PO em cites) pi 2 (x +A) 
x+n+1 N by 
= / g(t)dt+ Me aig t+n+1)— eV) + Sy(x, Hn), 
x k=1 


where 


i 


tay all x . tan 
Sv(x,n)=—- >| Po dt. 
joey 


(ec) Let yy, be the periodic function, with period 1, which satisfies w,(1) = 
gn(t) for 0 <t < 1. (Part (a) implhies that if n > 1, then w, 1s continuous, 
since 9g, (1) = y, (QO), and also that yy, is even if m is even and odd if n is 
odd.) Show that 


x+nt+l , 
Ao = I 
Sworn) == f ty eat 


xtnt+l 
I ieee : 
( = (- port / END dt if x 1s an integer), 


Unlike the remainder in ‘Taylor’s Theorem, the remainder Sy(x,7) usually 

does not satisfy slim Sn(x,n) = 0, because the Bernoulli numbers and functions 
—= 09 

become large very rapidly (although the first few examples do not suggest this). 
Nevertheless, unportant information can often be obtained from the summation 
formula. ‘The general situation is best discussed within the context ofa specialized 
study (“asymptotic series”), but the next problem shows one particularly unportant 
example. 


*€19, (a) Use the Euler-Maclaurin Formula, with N = 2, to show that 


log1+---+log(n — 1) 


n | l 1 n t) 
=] logs di = Flogn + 5 (= 1) 4 eS at. 


“= 


(b) Show that 


n} ial " Wot) 
log (ae) = Dp i‘ | Jee dt. 


ee) 
1 . . . ss 3 . 
(c) Explain why the improper integral B = / W(t) /2r- dt exists, and show 
| 


that if a =exp(p £ 11/12),-then 


Zz 
n! y(t) 

log | ———————— ] = - ¥2(t) dt. 
5 anttt/2e-n + 1/(12n) i ore 


(d) 


(h) 
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Problem 19-41(d) shows that 


Use part (c) to show that 
aen2nt! e—2ng2n 


Jr = lm ——____—. , 
n—>0oo a(2n)2n+1/2e—2n /y 


and conclude that a = V2z7. 


Show that 
1/2 ] 
/ p2(t) dt =| y(t) dt = 0. 
0) 0) 


(You can do the computations explicitly, but the result also follows 1m- 
mediately from Problem 18(a).) Conclude that 


F(x) [va ap for 0 =x = 1/2 
2) — t 
0 : =0)) fort 2 =< ie 


with w(n) = O for all n. Hint: Graph w on [0, 1], paying particular 
attention to its values at x9, 4, and x,, where xo and x; are the roots 
of 2 (Figure 9). 


FIGURE 9 


Noting that w(x) = —w(1 — x), show that 
W(x) = iL w(t)dt >0 on [0, 1], 
0 


and hence everywhere, with w(n) = 0 for all n. 
Finally, use this information and integration by parts to show that 


i v2) dt > 0. 
ee) 


Using the fact that the maximum value of |g2(x)| for x in [0, 1] is é> 


conclude that 
~° W(t) | 
O <= / eee << ion 


Finally, conclude that 


Sin ne 2a 2dr et 
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The final result of Problem 19, a strong form of Stirling’s Formula, shows that 
n! is approximately V2 n"*!/2e—" in the sense that this expression differs from n! 
by an amount which is small compared to n when n is large. For example, for 
n = 10 we obtain 3598696 instead of 3628800, with an error < 1%. 

A more general form of Stirling’s Formula illustrates the “asymptotic” nature of 
the summation formula. ‘The same argument which was used in Problem 19 can 
now be used to show that for N > 2 we have 


N 
n! by * Yn) 
ee es) ee dt. 
me i=—Ses! me k(k = 1)nF} n NUN 


Since Wy is bounded, we can obtain estimates of the form 


ERO = Mel 
a NG i 


If N is large, the constant My will also be large; but for very large n the factor 


n'~ will make the product very small. Thus, the expression 


N 


b, 
fy k 
V2 n € ep es SI 7) 


may be a very bad approximation for n! when n is small, but for large n (how large 
depends on N) it will be an extremely good one (how good depends on N). 


PART 5 


EPILOGUE 


There was a most ingenious Architect 
who had contrived a new Method 

for building Houses, 

by beginning at the Roof, and working 
downwards to the Foundation. 


JONATHAN SWIFT 


CHAPTER 


FIELDS 


‘Throughout this book a conscientious attempt has been made to define all im- 
portant concepts, even terms like “function,” for which an intuitive definition is 
often considered sufficient. But Q and R, the two main protagonists of this story, 
have only been named, never defined. What has never been defined can never be 
analyzed thoroughly, and “properties” P1 P13 must be considered assumptions, 
not theorems, about numbers. Nevertheless, the term “axiom” has been purposely 
avoided, and in this chapter the logical status of P1—P13 will be scrutinized more 
carefully. 

Like Q and R, the sets N and Z have also remained undefined. Truc, some 
talk about all four was inserted in Chapter 2, but those rough descriptions are far 
from a definition. To say, for example, that N consists of 1, 2, 3, etc., merely 
hames some elements of N without identifying them (and the “etc.” is useless). 
The natural numbers can be defined, but the procedure is involved and not quite 
pertinent to the rest of the book. The Suggested Reading list contains references 
to this problem, as well as to the other steps that are required if one wishes to 
develop calculus from its basic logical starting point. The further development 
of this program would proceed with the definition of Z, in terms of N, and the 
definition of Q in terms of Z. This program results in a certain well-defined 
set Q, certain explicitly defined operations + and -, and properties PI-P12 as 
theorems. The final step in this program 1s the construction of R, in terms of Q. 
It is this last construction which concerns us. Assuming that Q has been defined, 
and that P1~ P12 have been proved for Q, we shall ultimately define R and prove all 
Of lb lS‘tor R. 

Our intention of proving P1~P13 means that we must define not only real num- 
bers, but also addition and multiplication of real numbers. Indeed, the real num- 
bers are of interest only as a set together with these operations: how the real 
numbers behave with respect to addition and multiplication is crucial; what the 
real numbers may actually be is quite irrelevant. ‘This assertion can be expressed in 
a meaningful mathematical way, by using the concept of a “field,” which includes 
as special cases the three important number systems of this book. This extraordi- 
narily important abstraction of modern mathematics incorporates the properties 
P1]-P9 common to Q, R, and C. A field is a set F (of objects of any sort what- 
soever), together with two “binary operations” + and « defined on F (that is, two 
rules which associate to elements a and b in F, other elements a + b and ae b 
in F) for which the following conditions are satisfied: 

1) (atb)+c=at(b+c) foralla,b,andc in F. 
(2) There is some element 0 in F such that 


i) a+t0O=a _ forallaim F, 
(1) for every a in F, there is some element b m F such that a+b = 0. 
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3)a+tb=b+a forall aand bin F. 
(4) (a*b)*«c=a-+(b-c)  foralla,b, and c in F. 
(5) ‘There is some element 1 in F such that 1 4 0 and 


GQ) ael=a_forallain F, 
(i) For every a in F with a ¥ 0, there is some element b in F such that 
Gen = I. 


(66)a-b=bea _ forallaandbim F. 
(7) as(b+c) =aeb+aec forall a,b, and cin F. 


The familiar examples of fields are, as already indicated, Q, R, and C, with 
+ and + being the familiar operations of + and -. It is probably unnecessary to 
explain why these are fields, but the explanation is, at any rate, quite brief. When 
+ and + are understood to mean the ordinary + and -, the rules (1), (3), (4), (6), (7) 
are simply restatements of Pl, P4, P5, P8, P9; the elements which play the role of 0 
and 1 are the numbers 0 and | (which accounts for the choice of the symbols 0, 1); 
and the number b in (2) or (5) is —a or a~!, respectively. (For this reason, in an 
arbitrary field F we denote by —a the element such that a + (—a) = 0, and by 
a7! the element such that a-a7! = 1, for a £0.) 

In addition to Q, R, and C, there are several other fields which can be described 
easily. One example is the collection Fy of all numbers a + bV2 for a,bnQ. 
The operations + and « will, once again, be the usual + and - for real numbers. 
It is necessary to point out that these operations really do produce new elements 
of a: 


(a + bV/2) +(c+ dV2) =(at+c)+(b+ d)V/2, which is in F}; 
(a+ bV2) “(c+ dV2) = (ac + 2bd) + (be + ad)V2, which is in Fy. 


Conditions (1), (3), (4), (6), (7) for a field are obvious for F): since these hold for 
all real numbers, they certainly hold for all real numbers of the form a + bv2. 
Condition (2) holds because the number 0 = 0+0V2 isin F) and, for w = a+bV2 
in F, the number B = (—a) + (=b)/2 in F| satisfies a + B = O. Similarly, 
| = 1 +0V2 is in Fj, so (5i) is satisfied. The verification of (5ii) is the only slightly 
dificult pomt. If a+ bJ/2 #0, then 


] 
re —_ I: 
atby2 


it is therefore necessary to show that I/(a + bV2) is in Fy). This is true because 


| _ a—bV2 _ a (—b) J? 
at bY ee? Vie 4: b/ 2) ee = 20 ee 20 


(The division by a — bV2 is valid because the relation a — bV2 = 0 could be true 
only if a= b = 0 (sinee V2 is irrational) which is ruled out by the hypothesis 
a+tbVv2 == (),) 

The next example ofa field, 2, is considerably simpler in one respect: it con- 
tains only two elements, which we might as well denote by 0 and 1. ‘The operations 
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+ and « are described by the following tables. 


on 0 1 ° 0 1 
0 1 0 0 
1 1 0 1 0 1 


The verification of conditions (1)-(7) are straightforward, case-by-case checks. For 
example, condition (1) may be proved by checking the 8 equations obtained by 
setting a,b, c = 0 or 1. Notice that in this field 1 + 1 = 0; this equation may also 
be written 1 = =1. 

Our final example of a field is rather silly: F3 consists of all pairs (a,a) for a 
in R, and + and + are defined by 


(a,a) + (b,b) =(a+b,at+b), 
(7, a.) +, b) = (a= b, ab). 


(The + and - appearing on the right side are ordmary addition and multiplication 
for R.) The verification that F3 is a field is left to you as a simple exercise. 

A detailed investigation of the properties of fields is a study in itself, but for our 
purposes, fields provide an ideal framework in which to discuss the properties of 
numbers in the most economical way. For example, the consequences of P1-P9 
which were derived for “numbers” in Chapter | actually hold for any field; in 
particular, they are true for the fields Q, R, and C. 

Notice that certain common properties of Q,, R, and C do not hold for all fields. 
For example, it is possible for the equation 1 + 1 = 0 to hold in some fields, and 
consequently a — b = b—a does not necessarily imply that a = b. For the field 
C the assertion | + 1 4 0 was derived from the explicit description of C; for the 
fields Q and R, however, this assertion was derived from further properties which 
do not have analogues in the conditions for a field. There is a related concept 
which does use these properties. An ordered field is a field F (with operations + 
and +) together with a certain subset P of F (the “positive” elements) with the 
following properties: 


(8) For all a in F, one and only one of the following is true: 
fia — 0, 
(1) a isin P, 
(in) —a isn P. 
(9) If a and b are in P, then a + bis in P. 
(10) If a and b are in P, then a+ bis in P. 


We have already seen that the ficld G cannot be made into an ordered field. 
The field Fo, with only two elements, likewise cannot be made into an ordered 


field: in fact, condition (8), applied to 1 = —1, shows that 1 must be in P; then (9) 


imphes that 1 + 1 = 0 is in P, contradicting (8). On the other hand, the field Fy, 
consisting of all numbers a + bV2 with a,b in Q, certainly can be made into 
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an ordered field: let P be the set of all a + bV2 which are positive real numbers 
(in the ordinary sense). ‘The field #3 can also be made into an ordered field; the 
description of P is left to you. 

It is natural to introduce notation for an arbitrary ordered field which corre- 
sponds to that used for Q and R: we define 


a>b if a—bismP, 
<b il ba, 

exp a = b> ora —v, 
a> bb) i a> bora = bd. 


Using these definitions we can reproduce, for an arbitrary ordered field F, the 
definitions of Chapter 7: 


A set A of elements of F is bounded above if there is some x in F such 
that x 2 a for all a in A. Any such x ts called an upper bound for A. An 
element x of F is a least upper bound for A if x is an upper bound for A 
and x < y for every y in F which ts an upper bound for A. 


Finally, it is possible to state an analogue of property P13 for R; this leads to the 
last abstraction of this chapter: 


A complete ordered field is an ordered field in which every nonempty set 
which is bounded above has a least upper bound. 


The consideration of fields may seem to have taken us far from the goal of 
constructing the real numbers. However, we are now provided with an intelligible 
means of formulating this goal. ‘There are two questions which will be answered 
in the remaining two chapters: 


1. Is there a complete ordered field? 
2. Is there only one complete ordered field? 


Our starting point for these considerations will be Q, assumed to be an or- 
dered field, containing N and Z as certain subsets. At one crucial pomt it will be 
necessary to assume another fact about Q: 


Let x be an element of Q with x > 0. ‘Then for any y in Q there ts some n 
in N such that mx > y. 


This assumption, which asserts that the rational numbers have the Archimedean 
property of the real numbers, does not follow from the other properties of an 
ordered field (for the example that denronstrates this conclusively see reference [14] 
of the Suggested Reading). ‘The important point for us is that when Q is explicitly 
constructed, properties PI-P12 appear as theorems, and so does this additional 
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assumption; if we really began from the beginning, no assumptions about Q would 
be necessary. 


PROBLEMS 


1. Let F be the set {0, 1, 2} and define operations + and + on F by the following 
tables. (Lhe rule for constructing these tables is as follows: add or multiply 
in the usual way, and then subtract the highest possible multiple of 3; thus 
2g liso 242 —'I),) 


oe ° 0 ] z 
0) 0 
| 
2 2 


Show that F is a field, and prove that it cannot be made into an ordered 


field. 


2. Suppose now that we try to construct a field F having elements 0, 1, 
2, 3 with operations + and + defined as in the previous example, by adding 
or multiplying in the usual way, and then subtracting the highest possible 
multiple of 4. Show that F will nof be a field. 


3. Let F = {0,1, a, 8} and define operations + and + on F by the following 


tables. 
+ 0 | a p : 0 l a B 
0 0 
I | 
a a 
B B 


Show that F is a field. 


4. (a) Let F bea field in which 1 + 1 = 0. Show that a + a = 0 for all a (this 
can also be written a = —a). 
(b) Suppose that a + a = 0 for some a 4 0. Show that 1 + 1 = 0 (and 
consequently b + b = 0 for all b). 
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5. (a) Show that in any field we have 


m times n times mn times 


for all natural numbers m and n, 
(b) Suppose that in the field F we have 


EEE 
m times 


for some natural number m. Show that the smallest m with this property 
must be a prime number (this prime number ts called the characteristic 
Ghul): 


6. Let F be any field with only finitely many elements. 
(a) Show that there must be distinct natural numbers m and n with 


1+:---+l=1+4+.-:.-4+1. 


m times n times 


(b) Conclude that there is some natural number k with 


Wr Si 
——S_ 
k times 


7. Let a, b,c, and d be elements of a field F with a> d—b+c #0. Show that 
for any @ and f in F the equations 


acx+-b-ey=a, 
cox td-y= fp, 


can be solved for x and vy in F. 


8. Let a be an element ofa field F. A “square root” of a is an element b of F 
. 3) 
with b> =beb=a. 


(a) How many square roots does 0 have? 
(b) Suppose a 4 0. Show that if a has a square root, then it has two square 
roots, unless 1 + 1 = 0, m which case a has only one. 


9. (a) Consider an equation x2 + box +c = 0. where b and c are elements of 
a field F. Suppose that b? = 4+c¢ has a square root r in F. Show that 
(—b +r)/2 1s a solution of this equation. (Here 2 = 141 and 4 = 2+2.) 
(b) In the field Fy of the text, both elements clearly have a square root. 
On the other hand, it is easy to check that neither clement satisfies the 
equation x7 x #1 = 0. Thus some detail in part (a) must be incorrect. 
What ts it? 
10. Let F be a field and a an clement of F which does not have a square root. 


This problem shows how to construct a bigger field F’, containing F, in 


which a does have a square root. (‘This construction has already been carried 


iT. 
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through in a special case, namely, F = R and a = —1; this special case should 
guide you through this example.) 

Let F’ consist of all pairs (x, y) with x and y in F. If the operations on F 
are + and «, define operations ® and © on F’ as follows: 


xX, yOZw)=%+2Z,y+w), 
(x,y)O(Z,w)=%eZHtaryew,yrZ#X-w). 


(a) Prove that F’, with the operations ® and ©, 1s a field. 
(b) Prove that 


(x, 0) @ (y, 0) = @ + y, 0), 
@0)}C165 0) =1Gere y10); 


so that we may agree to abbreviate (x, 0) by x. 
(c) Find a square root of a = (a, 0) in F’. 


Let F be the set of all four-tuples (w, x, y,z) of real numbers. Define + 
and + by 


AI AROD iG al QR oe Berg) (Cc naa ee e/a ye Osi %%))5 


Heupel D3) ©) (CUDUT EXT 5 Vi) — SNOUT Na TAY aD Ni amNY 


Sy Ah) Ue — ia Se Udi Veo UN) 


(a) Show that F satisfies all conditions for a field, except (6). At times the 
algebra will become quite ornate, but the existence of multiplicative in- 
verses is the only point requiring any thought. 

(b) It is customary to denote 


(COSO50) Moyer: 
(0, 0, 1, 0) by J, 
(OFO}0 1) by kK. 


Find all 9 products of pairs i, j, and k. The results will show in particular 
that condition (6) is definitely false. This “skew field” F is known as the 
quaternions. 


CHAPTER 


CONSTRUCTION OF THE 
REAL NUMBERS 


The mass of drudgery which this chapter necessarily contaims is relieved by one 
truly first-rate idea. In order to prove that a complete ordered field exists we will 
have to explicitly describe one in detail; verifying conditions (1)—(10) for an ordered 
field will be a straightforward ordeal, but the description of the field itself, of the 
elements in it, Is Ingenious indeed. 

At our disposal is the set of rational numbers, and from this raw material it is 
necessary to produce the field which will ultimately be called the real numbers. 
‘To the uninitiated this must seem utterly hopeless —if only the rational numbers 
are known, where are the others to come from? By now we have had enough 
experience to realize that the situation may not be quite so hopeless as that casual 
consideration suggests. “The strategy to be adopted in our construction has already 
been used effectively for defining functions and complex numbers. Instead of 
trying to determine the “real nature” of these concepts, we settled for a definition 
that described enough about them to determine their mathematical properties 
completely. 

A similar proposal for defining real numbers requires a description of real num- 
bers in terms of rational numbers. ‘Vhe observation, that a real number ought to 
be determined completely by the set of rational numbers less than it, suggests a 
strikingly simple and quite attractive possibility: a real number might (and in fact 
eventually will) be described as a collection of rational numbers. In order to make 
this proposal effective, however, some means must be found for describing “the 
set of rational numbers less than a real number” without mentioning real num- 
bers, which are still nothing more than heuristic figments of our mathematical 
imagination. 

If A is to be regarded as the set of rational numbers which are less than the 
real number a, then A ought to have the following property: If x is in A and y 
is a rational number satisfying y < x, then y is in A. In addition to this property, 
the set A should have a few others. Since there should be some rational number 
x < a, the set A should not be empty. Likewise, since there should be some 
rauional number x > a, the set A should not be all of Q. Finally, if x < a@, then 
there should be another rational number y with x < y < a@, so A should not 
contam a greatest member. 

If we temporarily regard the real numbers as known, then it is not hard to 
check (Problem 8-17) that a set A with these properties is indeed the set of rational 
numbers less than some real number @. Since the real numbers are presently 
in limbo, your proof, if you supply one, must be regarded only as an unofficial 
comment on these proceedings. It will serve to conviice you, however, that we 
have not failed to nouce any crucial property of the set A. ‘There appears to be 
no reason for hesitating any longer. 
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DEFINITION A real number is a set @, of rational numbers, with the following four proper- 


is some y nq@ with y > x. 


‘The set of all real numbers is denoted by R. 


Just to remind you of the philosophy behind our definition, here is an explicit 
example of a real number: 


CM (Py) ae ey roa 


It should be clear that @ is the real number which will eventually be known as V2, 
but it is not an entirely trivial exercise to show that @ actually is a real number. 
The whole pomt of such an exercise is to prove this using only facts about Q; 
the hard part will be checking condition (4), but this has already appeared as a 
problem in a previous chapter (findmg out which one is up to you). Notice that 
condition (4), although quite bothersome here, is really essential in order to avoid 
ambiguity; without it both 
tet ©): MZ |.) 
and 


{x 1n1@ 2 x <T} 


would be candidates for the “real number 1.” 

The shift from A to @ in our definition indicates both a conceptual and a no- 
tational concern. Henceforth, a real number is, by definition, a set of rational 
numbers. ‘This means, mm particular, that a rational number (a member of Q) 
is not a real number; instead every rational number x has a natural counterpart 
which is a real number, namely, {y in Q : y < x}. After completing the construc- 
tion of the real numbers, we can mentally throw away the elements of Q and 
agree that Q will henceforth denote these special sets. For the moment, however, 
it will be necessary to work at the same time with rational numbers, real numbers 
(sets of rational numbers) and even sets of real numbers (sets of sets of rational 
numbers). Some confusion is perhaps inevitable, but proper notation should keep 
this toa minimum. Rational numbers will be denoted by lower case Roman letters 
(x, y, z, a, b, c) and real numbers by lower case Greek letters (a, 8, y); capital 
Roman letters (A, B, C) will be used to denote sets of real numbers. 

The remainder of this chapter is devoted to the definition of +, +, and P for R, 
and a proof that with these structures R is indeed a complete ordered field. 

We shall actually begin with the defimition of P, and even here we shall work 
backwards. We first define a < f; later, when 4, +, and 0 are available, we shall 
define P as the set of all @ with 0 < a, and prove the necessary properties for P. 
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THEOREM 


PROOF 


The reason for beginning with the definition of < is the simplicity of this concept 
in our present setup: 


Definition. If a and B are real numbers, then w < B means that @ is contained in 
f (that is, every element of @ is also an element of f), but a # f. 


A repetition of the definitions of S$, >, 2 would be stultifying, but it is interesting 
to note that S$ can now be expressed more simply than <; if @ and £ are real 
numbers, then a S$ f if and only if @ is contamed in B. 

If A is a bounded collection of real numbers, it is almost obvious that A should 
have a least upper bound. Each @ i A is a collection of rational numbers; if these 
rational numbers are all put in one collection B, then B is presumably sup A. In 
the proof of the followmeg theorem we check all the little details which have not 
been mentioned, not least of which is the assertion that B is a real number. (We 
will not bother numbering theorems in this chapter, since they all add up to one 
big ‘Pheorem: There is a complete ordered field.) 


If A is a set of real numbers and A ¥ # and A is bounded above, then A has a 
least upper bound. 


Let B = {x : x isin somea im A}. Then # 1s certamly a collection of rational 

numbers; the proof that 6 is a real number requires checking four facts. 
(1) Suppose that x is in 6 and y < x. The first condition means that x is in @ 
for some @ in A. Since @ is a real number, the assumption y < x implies 
that y is in @. Therefore it is certainly truce that y is in fp. 

(2) Since A 4 Y, there is some a in A. Since @ is a real number, there is some 
x ina. This means that x is in B, so B £ V. 

(3) Since A is bounded above, there is some real number y such that a < y 
for every a in A. Since y is a real number, there 1s some rational number 
x which is not in y. Now a < y means that @ is contained in y, so it 1s 
also true that x is not in @ for any aw in A. This means that x is not in B; 
80.82 Oe 

(4) Suppose that x is in 6. Then x is in @ for some @ in A. Since @ does not 
have a greatest member, there is some rational number y with x < y and y 
nia. But this means that y ts in B; thus 6 does not have a greatest member. 


These four observations prove that £ is a real number. The proof that B is the 
least upper bound of A is easier. If @ is in A, then clearly @ is contained in f; this 
means that a < B, so B is an upper bound for A. On the other hand, if y ts au 
upper bound for A, then a S y for every a@ in A; this means that @ is contained 
in y, for every a in A, and this surely implies that £ is contained in y. 7s, im 
turn, means that B < y; thus £ is the least upper bound of A. ff 


The definition of + is both obvious and easy, but is must be complemented with 
a proof that this “obvious” definition makes any sense at all. 
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Defuntiou. Wf a and B are real numbers, then 


a+P={x:x =y+zc for some y ina and some ¢ in f}. 


THEOREM If a and B are real numbers, then a + f is a real number. 


PROOF ~~ Once again four facts must be verified. 


(1) 


Suppose w <x for some x ina + 6. Then x = y +z for some y in @ and 
some z in B, which means that w < y + z, and consequently, w — y < z. 
‘This shows that w — y is in f (since z is in B, and £ is a real number). Since 
w= y+(w— y), it follows that w is in a + B. 

It is clear that a + B #V, since aw 4% and Bp FV. 

Since a # Q and B F Q, there are rational numbers a and b with a 
not in @ and b not in B. Any x in @ satisfies x < a (for if a < x, then 
condition (1) for a real number would imply that @ is m @); similarly any y 
in B satisfies y < b. Thus x + y < a+b for any x in @ and yin fs. This 
shows that a+b is notina + B,sow+pF4Q. 

If xis m @ +56, then: %.= yebz for y inesandez inpfeeal here ane, pounl o 
and z’ in B with y < y’ and z < 73; then x < y’+2' and y’+Z isina +f. 
Thus aw + £ has no greatest member. J 


By now you can see how tiresome this whole procedure is going to be. Every time 


we mention a new real number, we must prove that it 7s a real number; this requires 


checking four conditions, and even when trivial they require concentration. There 
is really no help for this (except that it will be less boring if you check the four 


conditions for yourself). Fortunately, however, a few points of interest will arise 


now and then, and some of our theorems will be easy. In particular, two properties 
of + present no problems. 


THEOREM If a, B, and y are real numbers, then (@ + 6) 4y =a+(P +y). 


PROOF Since (x + y)+zZ =*x+()+2) for all rational numbers x, y, and z, every member 
of (a + B) + y is also a member of a + (6 + y), and vice versa. ff 


THEOREM If w and f are real numbers, then aw + 6 = Bp +a. 


PROOF Left to you (even easier). ff 


‘To prove the other properties of - we first define 0. 


Defution. 0 = (x inQ:x < O}. 


It is, thank goodness, obvious that 0 is a real number, and the followmg theorem 


is also simple. 
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THEOREM 


PROOF 


THEOREM 


PROOF 


If aw is a real number, then a + O=a. 


If x isinq@ and y is in 0, then y < 0,so x+y < x. This implies that «+ y is ina. 
Thus every member of a@ + 0 is also a member of @. 

On the other hand, if x is nm @, then there is a rational number y in @ such that 
y > x. Since x = y + (x — y), where y is in @, and x — y < 0 (so that x — y is 
in 0), this shows that x is in @ + 0. ‘Thus every member of @ is also a member 


of a +0. 


‘ 1e reasonabie Canc iC ate or YY Would seem to pe the se 
i bl lidate f Id to be tl i 


{x in Q : —x Is not in a} 


(since —X not in @ means, intuitively, that —x > @, so that x < —q@). But in certain 
cases this set will not even be a real number. Although a real number @ does not 
have a greatest member, the set 


Oa = {im Ox is nota, 


may have a least element x9; when @ is a real number of this kind, the set 
{x : —x is not in @} will have a greatest element —xo. It is therefore necessary to 
introduce a slight modification mto the definition of —a@, which comes equipped 
with a theorem. 


Definition. If @ is a real number, then 


—o = {vin Q: —x is notina, but — x is not the least element of Q — a}. 


If @ is a real number, then —a@ is a real number. 


(1) Suppose that x isin —a@ and y < x. Then —y > —x. Since —x is notin, 
it is also true that —y is not ma. Moreover, it is clear that —y 1s not the 
smallest element of Q — a, since —x is a smaller element. This shows that 
yism —q. 

(2) Since a 4 Q, there is some rational number y which is not ma. We can 
assume that y is not the smallest rational number n Q — @ (since y can 
always be replaced by any y’ > y). Then —y is in —a. Thus -—@ ¥ 9%. 

(3) Since a # Y, there is some x ina. Then —x cannot possibly be in =a, so 
=o FD): 

(4) If x is m —a, then —x is not in a, and there is a rational number y < —x 
which is also not na. Let z be a rational number with y < < < —x. ‘Then 
z is also not in q@, and z is clearly not the smallest element of Q — a. So 
—z ism —a. Since —c > x, this shows that —a@ does not have a greatest 
element. J 


The proof that a + (-a@) = 0 1s not entirely straightforward. ‘Vhe difficulties 
are not caused, as you might presume, by the finicky details in the definition 


LEMMA 


PROOF 


THEOREM 


PROOF 
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of —a. Rather, at this point we require the Archimedean property of Q stated on 
page 584, which does not follow from Pl P12. This property is needed to prove 
the following lemma, which plays a crucial role in the next theorem. 


Let a be areal number, and z a positive rational number. ‘Then there are (Figure 1) 
rational numbers x in a, and y not in a, such that y — x = z. Moreover, we may 
assuine that y is not the smallest element of Q — a. 


Suppose first that z is in a. If the numbers 
22 8 OR er 


were all m a, then every rational number would be in q@, since every rational num- 
ber w satisfies w < nz for some n, by the additional assumption on page 584. ‘This 
contradicts the fact that @ is a real number, so there is some k such that x = kz is 
ina and y = (k+ 1)z is not n a. Clearly y — x = z. 

Moreover, if y happens to be the smallest element of Q — a, let x’ > x be an 
element of a, and replace x by x’, and y by y + (”’ — x). 

If z is not nq, there is a similar proof, based on the fact that the numbers (—n)z 
cannot all fail to be ina. J 


> 
“ 


etiam 
(O4 { 
| 
FIGURE 1 x by 
If aw is a real number, then 
a + (—a) = 0. 


Suppose x is in @ and y isin —a@. Then —y is not m a, so —y > x. Hence 
x+y <0,so x+yisin 0. Thus every member of aw + (—a@) is in 0. 

It is a little more difficult to go in the other direction. If z is in 0, then —z > 0. 
According to the lemma, there is some x in a, and some y not in @, with y not the 
smallest element of Q — a, such that y — x = —z. This equation can be written 
x+(—y) =<. Since x is ina, and —y is nm —a, this proves that z is ina + (—a). J 


Before proceeding with multiplication, we define the “positive elements” and 
prove a basic property: 


Definition. P = {a n R: a@ > O}. 


Notice that a + f is clearly in P if @ and B are. 
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THEOREM 


PROOF 


THEOREM 


PROOF 


THEOREM 


If w is a real number, then one and only one of the following conditions holds: 


(ieQeee O, 
(ii) a is in P, 
(iii) —a@ is in P. 


If aw contains any positive rational number, then @ certainly contains all negative 

/ 5 
rational numbers, so @ contains 0 and @ # 0, i.e., a isin P. If contains no 
positive rational numbers, then one of two possibilities niust hold: 


(1) @ contains all negative rational numbers; then a = 0. 

(2) there is some negative rational number x which is not m @: it can be as- 
sumed that x is not the least element of Q — @ (since x could be replaced 
by x/2 > x); then -@ contains the positive rational number —x, so, as we 
have just proved, —a@ is in P. 


This shows that at least one of (i)-(iii) must hold. If @ = 0, it is clearly impossible 
for condition (ii) or (iii) to hold. Moreover, it is impossible that a > 0 and —a > 0 
both hold, since this would imply that 0 = a + (—a@) > 0. | 


Recall that a > B was defined to mean that a contains B, but is unequal to f. 
This definition was fine for proving completeness, but now we have to show that 
it is equivalent to the definition which would be made in terms of P. Thus, we 
must show that aw — B > 0 is equivalent to w@ > B. This is clearly a consequence 
of the next theorem. 


If w, B, and y are real numbers and aw > f, thena+y > +y. 


The hypothesis « > 6 implies that B is contained in a; it follows immediately from 
the definition of + that B+y is contained ina+y. This shows that a+y 2 B+y. 
We can easily rule out the possibility of equality, for if 


aty=fht+y. 


then 


a=(aty)t(-y)=B+tVY +(-y) =B6, 
which is false. Thusa+y >i +y.§ 


Multiplication presents difficultics of its own. I a, B > 0, then a+ B can be 
defined as follows. 


Definition. Wf a and B are real numbers and a, B > 0, then 


a-B={z:2<0orz=x-y forsome x in@ and y in B with x, y > 0}. 


If w and B are real numbers with a, B > 0, then a+ is a real number. 


PROOF 


THEOREM 


PROOF 


THEOREM 
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As usual, we must check four conditions. 


(1) Suppose w < c, where z is ina» £B. If w < 0, then w is automatically 
in ae B. Suppose that w > 0. Then z > 0, so z = x - y for some positive x 
in @ and positive y in B. Now 


wz WXY w 
oe = — | m= ey 


Since 0 < w < s, we have w/z < 1,s0 (w/z)-x isin a@. Thus w is ma « £. 
Clearly a+ BAY. 


2) 
(3) Ifxas not in @, and wis not m B, then x > x’ for allw’ama, andy > 3 


for all y’ in B. Hence xy > x'y’ for all such positive x’ and y’. So xy is not 
ina+f;thusa-Bp4Q. 

(4) Suppose w is in a+ B, and w < 0. There is some x in @ with x > 0 and 
some yin 6 with y > 0. Then z = xy is n a+ 8 and z > w. Now suppose 
uw > 0. Then w = xy for some positive x m a@ and some positive y in B. 
Moreover, @ contains some t—e> +; "5f £7.79 ten" ay — we alice Is 
in ae. Thus a+ B does not have a greatest element. 


Notice that @ + B is clearly in P if @ and £ are. This completes the verification 
of all properties of P. ‘To complete the definition of + we first define |a|. 


Definition. If a@ is a real number, then 


la| = 


Definition. If a and B are real numbers, then 


0. ia —0 ors — 0 
a@8 =~ lel ipl. fa>0,B >O0ora <0,f <0 
—(la|]-|A|), tfa>0,68 <Oora <0,f >0. 


As one might suspect, the proofs of the properties of multiplication usually m- 
volve reduction to the case of positive numbers. 


If a, B, and y are real numbers, then a + (B+ y) = (a- B)ey. 


This is clear if a, B, y > 0. The proof for the general case requires considering 
separate cases (and is simplified slightly if one uses the following theorem). J 


If @ and 6 are real numbers, then a + B = Bea. 
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THEOREM If a is a real number uncqual to 0, then a7 


PROOF ‘This ts clear if @, B > 0, and the other cases are easily checked. J 


Depron.” = fx a Ow: xr <_1}. 
(It is clear that 1 is a real number.) 


THEOREM If w is a real number, then a-l=a. 


PROOF = Let a > 0. It is easy to see that every member of @ +1 is also a member of a@. 
On the other hand, suppose x is in@. If x < 0, then x is automatically in a «1. 
If x > O, then there is some rational number y in @ such that x < y. Then 
Xx =<) -(@yy eanues /yism lyso x isin@-4. This proves thate-l—=am ae>0. 
If w <0, then, applying the result just proved, we have 


ael=—(fa]- lJ) = —(a]) =a. 


Finally, the theorem is obvious when a = 0. J 


Defimtion. If a is a real number and a > 0, then 
a7! = {xin Q : x <0, or x > 0 and I/x is not in a, but 1/x is not the smallest 


member of Q — a}; 


if a <0, then a7! = =—(faf)7!. 


1 is a real number. 


PROOF — Clearly it suffices to consider only a > 0. Four conditions must be checked. 


(1) Suppose y <x, and x isin a@7!. If y < 0, then y isin a7!. If y > 0, then 
x = 0 s0'l/x is not in e. Since_l/y = I/x< 10 follows that 1 /sa1s notin 
and I /y is clearly not the smallest element of Q — a, so y is in a7. 

(2) Clearly a7! £ @. 

(3) Since a > O, there is some positive rational number x in a. Then |/x ts 
notin a7}, soa! 4 Q. 


(4) Suppose x is in a7, 


—! Contains some positive rationals. If x > 0, then 1/x is not ina. 


If x < 0, there is clearly some y in a7! with Wass 
because @ 
Since 1/x is not the smallest member of Q — a, there is a rational number 
y not in a, with y < I/x. Choose a rational number ¢ with y < ¢ < I/yx. 
Then 1/z is in a7!, and 1/z > x. Thus a7! does not contain a largest 


member. J 


In order to prove that a7! is really the multiplicative inverse of a, it helps to 
have another lemma, which is the multiplicative analogue of our first lemma. 


LEMMA Let a be a real number with @ > 0, and z a rational number with < > 1. ‘Then 
there are rauonal numbers x i @, and y not ina, such that y/x = zc. Moreover, 
we can assume that y is not the least clement of Q — a. 


PROOF 


THEOREM 


PROOF 


THEOREM 


PROOF 
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Suppose first that z is ina. Since ¢ — | > O and 
ee laste cel) eran (Za), 


it follows that the numbers 
es 


7 = -~ 
wr A 9h Geers 


k 


isina,and y =z‘! 


cannot all be ina. So there is some k such that « = z is not 
in a. Clearly y/x =<. Moreover, if y happens to be the least element of Q — a, 
let x’ > x be an element of a, and replace x by x’ and y by yx'/x. 

If z is not in a, there is a similar proof, based on the fact that the numbers 1/2‘ 


cannot all fail to be ina. J 
If aw is areal number and a 40, then a-a7! = 1. 


It obviously suffices to consider only a > 0, in which case a7! > 0. Suppose that 
X 1s a positive rational number in @, and y is a positive rational number in a7. 
Then !I/y is not in a, so 1/y > x; consequently xy < 1, which means that xy is 
in 1. Since all rational numbers x < 0 are also in 1, this shows that every member 
Of a. a Wisin! 

To prove the converse assertion, let z be in 1. If z < 0, then clearly z is in 
aa, Suppose 0 < z < 1. According to the lemma, there are positive rational 
numbers x in a, and y not ina, such that y/x = 1/z; and we can assume that y 
is not the smallest element of Q —a@. But this means that z = x - (1/y), where x 
is mar, and 1/y is in a7). Consequently, z is ina- a7. § 

We are almost done! Only the proof of the distributive law remains. Once again 
we must consider many cases, but do not despair. The case when all numbers are 
positive contains an interesting point, and the other cases can all be taken care of 


very neatly. 
If a, B, and y are real numbers, thena+(B +y) =a+B+ary. 


Assume first that a, B, y > 0. ‘Then both numbers in the equation contain all 
rational numbers < 0. A positive rational number in @ « (6 + y) is of the form 
x -(y +z) for positive x in a, y in B, and zin y. Since x- (vy +z) =x-y+x-z, 
where x + y is a positive element of @ + 6, and x - z is a positive element of a y, 
this number is also in@+ B #a-y. Thus, every element of @ + (6B + y) is also in 
a-P+oaecy. 

On the other hand, a positive rational number in a+ 6 # a+ y ts of the form 
x1.-y + x2 +z for positrve xj,.x2 in a, y in B, and z in y. If x, < xo, then 
(xy/x2) > ¥ = ¥,s0 (hy / xo) -y is nf. Thus 


XP YX = wy (X%,/x9)¥ P'S] 


isinae(6B + y). Of course, the same trick works if x2 <x). 
To complete the proof it is necessary to consider the cases when a, B, and y 
are not all >0. If any one of the three equals 0, the proof is easy and the cases 
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involving a < 0 can be derived immediately once all the possibilities for 6 and 
y have been accounted for. Thus we assume aw > 0 and consider three cases: 
Bb. y <0,and Bp <0, y > 0,and p > 0, y <9. The first follows immediately from 
the case already proved, and the third follows from the second by interchanging B 
and y. ‘Vherefore we concentrate on the case B <0, y > 0. There are then two 
possibilties: 


(1) B +y 20. Then 
aey=a-((Pty]+t[PP=a-(P+ty) +a: Al. 
sO 


a-(P+ty)=—(a- |B) ta-y 


asB+taery. 


(2)B+y <0. Then 
a+ |[Bl[=a-(Btylty=a-[B+yl tary, 


sO 


a-(Bby)=—@-[B+y)=-@-|A)toe-y=a-p+oaryf 


This proof completes the work of the chapter. Although long and frequently 
tedious, this chapter contains results suffictently important to be read in detail at 
least once (and preferably not more than once!). For the first ume we know that we 
have not been operating in a vacuum ~ there is indeed a complete ordercd field, the 
theorems of this book are not based on assumptions which can never be realized. 
One interesung and horrid possibility remains: there may be several complete 
ordered fields. If this is true, then the theorems of calculus are unexpectedly rich 
in content, but the properties P1-P13 are disappointingly incomplete. ‘The last 
chapter disposes of this possibility; properties PI-P13 completely characterize the 
real numbers—anything that can be proved about real numbers can be proved on 
the basis of these properties alone. 


PROBLEMS 

There are only two problems im this set, but each asks for an entirely cifferent 
construction of the real numbers! ‘The detailed examination of another construc- 
tion is recommended only for masochists, but the main idea behind these other 
constructions is worth knowing. “Phe real numbers constructed in this chapter 
might be called “the algebraist’s real numbers,” since they were purposely defined 
so as to guarantee the least upper bound property, which involves the ordering <, 
an algebraic notion. “Vhe real number system constructed in the next problem 
night be called “the analyst’s real numbers,” since they are devised so that Cauchy 


sequences will always converge. 


1. Smee every real number ought to be the hmit of some Cauchy sequence 
of rational numbers, we nnght try to define a real number to be a Cauchy 
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sequence of rational numbers. Since two Cauchy sequences night converge 
to the same real number, however, this proposal requires some modifications. 


(a) Define two Cauchy sequences of rational numbers {a,} and {b,} to be 
equivalent (denoted by {a,} ~ {b,}) if lim (a, — b,) = 0. Prove that 
iH 0 


tan} ~" {an}, that {b,} ~ {ta,) if fa,} ~ {b,}, atid that {a} ~ {aehil 
{an} ~ {bn} and {bn} ~ {en}. 

(b) Suppose that @ ts the set of all sequences equivalent to {a,}, and B is the 
set of all sequences equivalent to {b,}. Prove that either aM B = Y or 
a= fp. If ap £¥, then there is some {c,} m both aw and B. Show that 
in this case a@ and f both consist precisely of those sequences equivalent 
to {Cp }.) 


Part (b) shows that the collection of all Gauchy sequences can be split up 
into clisjomt sets, each set consisting of all sequences equivalent to some 
fixed sequence. We define a real number to be such a collection, and 
denote the set of all real numbers by R. 

(c) If @ and B are real numbers, let {a,} be a sequence in a, and {b,} a 
sequence in B. Define a + B to be the collection of all sequences equiva- 
lent to the sequence {a, +,}. Show that {a, +,} 1s a Cauchy sequence 
and also show that this definition does not depend on the particular se- 
quences {a,} and {b,} chosen for @ and B. Check also that the analogous 
definition of multiplication is well defined. 

(d) Show that R is a field with these operations; existence of a multiplicative 
inverse 1s the only teresting point to check. 

(ec) Define the positive real numbers P so that R will be an ordered field. 

(f) Prove that every Cauchy sequence of real numbers converges. Remem- 
ber that if {a} is a sequence of real numbers, then each a, is itself a 
collection of Cauchy sequences of rational numbers. 


This problem outlines a construction of “the high-school student’s real num- 
bers.” We define a real number to be a pair (a, {by}), where a@ is an inte- 
ger and {b,} is a sequence of natural numbers from 0 to 9, with the pro- 
viso that the sequence is not eventually 9; intuitively, this pair represents 


CO 
a+ ) b, 10°". With this definition, a real number is a very concrete ob- 


n=! 


ject, but the dificultes involved m defining addition and multiplication are 


formidable (how do you add infinite decimals without worrying about car- 
rying digits infinitely far out?). A reasonable approach is outlined below; the 
trick is to use least upper bounds right from the start. 


(a) Define (a, {by}) < (c, {d,}) if a <ve, or af @ =e and forisome-n we lave 
b, <d, but bj} =d; for 1 < j <n. Using this definition, prove the least 
upper bound property. 


k 
(b) Green a = (4; {bq}), define a; =—"a + Lal "> intuitively, ag is the 


n=] 
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rational number obtained by changing all decimal places after the kth 
k 


to 0. Conversely, given a rational number r of the form a + ) Dane 


n=l 
let r’ denote the real number (a, {b,’}), where b,’ = b, for 1 <n <k 


and b,’ = 0 for n > k. Now for a = (a, {b,}) and B = (c, {d,}) define 
a + B = sup{(a, + B,)’ : k a natural number} 


(the least upper bound exists by part (a)). If multiplication is defined 
similarly, then the verification of all conditions for a field is a straight- 
forward task, not highly recommended. Once more, however, existence 
of multiplicative inverses will be the hardest. 


CHAPTER 


UNIQUENESS OF THE REAL NUMBERS 


We shall now revert to the usual notation for real numbers, reserving boldface 
symbols for other fields which may turn up. Moreover, we will regard integers and 
rational numbers as special kinds of real numbers, and forget about the specific 
way in which real numbers were defined. In this chapter we are interested in only 
one question: are there any complete ordered fields other than R? The answer 
to this question, if taken literally, is “yes.” For example, the field F3 introduced in 
Chapter 28 is a complete ordered field, and it is certainly not R. This field is a 
“silly” example because the pair (a, a) can be regarded as just another name for 
the real number a; the operations 


(a,a) + (b,b) =(a+b,at+b), 
(alan. (hb) =(a-D. a+b 


are consistent with this renaming. ‘This sort of example shows that any intelligent 
consideration of the question requires some mathematical means of discussing such 
renaming procedures. 

If the elements of a field F are going to be used to rename elements of R, then 
for each a in R there should correspond a “name” f(a) in F. The notation f(a) 
suggests that renaming can be formulated in terms of functions. In order to do 
this we will need a concept of function much more general than any which has 
occurred until now; in fact, we will require the most general notion of “function” 
used in mathematics. A function, m this general sense, is simply a rule which 
assigns to some things, other things. ‘To be formal, a function is a collection of 
ordered pairs (of objects of any sort) which does not contain two distinct pairs with 
the same first element. The domain of a function f is the set A of all objects a 
such that (a,b) is in f for some 6; this (unique) b is denoted by f(a). If f(a) is 
in the set B for all a in A, then /f is called a function from A to B. For example, 


if f(x) = sinx for all x in R (and /f is defined only for x in R), then f is a 
function from R to R; it is also a function from R to [—1. 1]; 


if f(z) =simz for all zn G, then f is a function from C to C; 


if f(z) = e* for all. gin GC, then f is a function from C to C; it is also a 
function from C to {z in G:z £0}: 


Chis.a-funation ‘from {zing 0} to (x nn R:0 <4 <27)}; 


if f is the collection of all pairs (a, (a,a)) for a m R, then f is a function 
from R to F3. 
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Suppose that Fy and F2 are two fields; we will denote the operations in Fy by 
®, ©, etc., and the operations in Fy by +, +, etc. If Fz is going to be considered 
as a collection of new names for elements of Fy, then there should be a function 
from F; to F2 with the following properties: 


(1) The function f should be one-one, that is, if x 4 y, then we should have 
f(x) # f(y); this means that no two elements of Fy have the same name. 

(2) The function f should be “onto,” that is, for every element z in F> there 
should be some x in Fj such that z = f(x); this means that every element 
of F> is used to name some element of F|. 

(3) For all x and y in F; we should have 


fe Oy = fat fO), 
faOy) = fX)> fy); 


this means that the renaming procedure is consistent with the operations of 


the field. 


If we are also considering Fy and F> as ordered fields, we add one more re- 


quirement: 
(4) If x @y, then f(x) < f(y). 


A function with these properties is called an tsomorphism from Fy, to Fy. ‘This 
definition is so important that we restate it formally. 


DEFINITION If F, and Fy) are two fields, an isomorphism from F| to F> 1s a function f 
from F | to F2 with the following properties: 


(1) If x #y, then fx) # f(). 
(2) If cist@eoe then z— f() for some x in F}. 
(3) If x and y are in Fj, then 


f(x ®y)= fx) + fO), 
f(x Oy) = fx) FY). 


If Fy and F> are ordered fields we also require: 


(4) If x @y, then f(x) < fi). 


The fields Fy and F> are called isomorphic if there is an isomorphism between 
them. Isomorphic fields may be regarded as essentially the same—any important 
property of one will automatically hold for the other. Therefore, we can, and 
should, reformulate the question asked at the beginning of the chapter; if F is a 
complete ordered field it is silly to expect F to equal R—rather, we would like to 
know if F is isomorphic to R. In the following theorem, F will be a held, with 
operations + and +, and “positive elements” P; we write a < b to mean that b=a 


is in P, and so forth. 


THEOREM 


PROOF 
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If F is a complete ordered field, then F is isomorphic to R. 


Since two fields are defined to be isomorphic if there is an isomorphism between 
them, we must actually construct a function f from R to F which is an isomor- 
phism. We begin by defining f on the integers as follows: 


fmal+...+1 forn > QO, 
ast cals 
n times 
fiay=—(1+...4+1) for n=O. 
es 
|n| times 


It is easy to check that 


f(m+n)= f(m) + f(r), 
flimen) = fin) =a 


for all integers m and n, and it is convenient to denote f(n) by n. We then 
define f on the rational numbers by 


f(m/n) =m[n=m- n-! 

(notice that the n-fold sum 1 +--- +140 if n > 0, since F is an ordered field). 
‘This definition makes sense because if m/n = k/1, then ml = nk, so mel = ken, so 
m-n7!=k-I-!. It is easy to check that 


7 try) — [(F1) tf 02), 
fri +12) = fri) + fra). 


for all rational numbers r; and r2, and that f(r) < f(r2) if ry < ro. 

The definition of f(x) for arbitrary x 1s based on the now familiar idea that 
any real number is determined by the rational numbers less than it. For any x 
in R, let A, be the subset of F consisting of all f(r), for all rational numbers 
r <x. The set A, is certainly not empty, and it is also bounded above, for if ro 
is a rational number with rg > x, then f(ro) > f(r) for all f(r) in Ay. Since F 
is a complete ordered field, the set Ay has a least upper bound; we define f(x) as 
sup Ax. 

We now have f(x) defined in two different ways, first for rational x, and then for 
any x. Before proceeding further, it is necessary to show that these two definitions 
agree for rational x. In other words, if x is a rational number, we want to show 
that 


sup Ay = f(x), 


where f(x) here denotes m/f, for x = m/n. ‘This is not automatic, but depends 
on the completeness of F; a slight digression is thus required. 
Since F is complete, the elements 


1+...4+1 for natural numbers n 
ae, see! 


n times 
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form a set which is not bounded above; the proof is exactly the same as the proof 
for R (Theorem 8-2). The consequences of this fact for R have exact analogues 
in F: in particular, if a and b are elements of F with a < b, then there is a rational 
number r such that 


a< f(r) <b. 


Having made this observation, we return to the proof that the two definitions 
of f(x) agree for rational x. If y ts a rational number with y < x, then we 
have already seen that f(y) < f(x). Thus every element of A, is < f(x). 
Consequently, 

sup Ax S f (x). 


On the other hand, suppose that we had 
sup Ay < f()} 
Then there would be a rational number r such that 
sup Ay < f(r) < f(). 


But the condition f(r) < f(+*) means that r < x, which means that f(r) is in the 
set Ay; this clearly contradicts the condition sup Ay < f(r). This shows that the 
original assumption is false, so 


SUA = alt) 


We thus have a certain well-defined function f from R to F. In order to show 
that f is an isomorphism we must verify conditions (1)—(4) of the definition. We 
will begin with (4). 

If x and y are real numbers with x < y, then clearly A, is contained in Ay. 
‘Thus 

f(x) = sup A, < supA, = f(y). 


To rule out the possibility of equality, notice that there are rational numbers r 
and s with 
X= ils <asteany 2 


We know that f(r) < f(s). It follows that 
Lit) Sf (ey fies fee 


This proves (4). 

Condition (1) follows immediately from (4): If x 4 y, then either x < y or 
y_<exp in thevfirst case f(@) << ef(y), and im the second case f(y) < /(«); im 
either case f(x) ==) Gr 

To prove (2), let a be an element of F, and let B be the set of all rational 
numbers r with f(r) <a. The set B is not empty, and it is also bounded above, 
because there is a rational number s with f(s) > a, so that f(s) > f(r) for r 
in B, which implies that s > r. Let x be the least upper bound of B; we claim 
that f(x) =a. In order to prove this it suffices to eliminate the alternatives 


f(x) <a, 
a< fy 
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In the first case there would be a rational number r with 


Jie fO) <a, 


But this means that x < r and that r is in B, which contradicts the fact that 
x = sup B. In the second case there would be a rational number r with 


G= 7) =7). 


This implies that r < x. Since x = sup B, this means that r < s for some s in B. 
Hence 


SOs f(s) <a 


again a contradiction. Thus f(x) = a, proving (2). 
To check (3), let x and y be real numbers and suppose that f(x + y) # 
f(x) + f(y). Then either 


peasy) < fie) + Pep or JO) FiO) <7 7 
In the first case there would be a rational number r such that 
fx+ty) < fr) < f(x) + fQ). 


But this would mean that 
| pV aed 


Therefore r could be written as the sum of two rational numbers 
r=ry tro, where x <r, and y <?rp. 
Then, using the facts checked about f for rational numbers, it would follow that 
j= fitn) =F) = 7 ers). 


a contradiction. The other case is handled similarly. 
Finally, if x and y are positive real numbers, the same sort of reasoning shows 
that 
I Dee): 


the general case is then a simple consequence. J 


This theorem brings to an end our investigation of the real numbers, and resolves 
any doubts about them: ‘There 7s a complete ordered field and, up to isomorphism, 
only one complete ordercd ficld. It is an important part of a mathematical educa- 
tion to follow a construction of the real numbers in detail, but it is not necessary 
to refer cvcr again to this particular construction. It is utterly irrelevant that a real 
number happens to be a collection of rational numbers, and such a fact should 
never enter the proof of any important theorem about the real numbers. Reason- 
able proofs should use only the fact that the real numbers are a complete ordered 
ficld, because this property of the real numbers characterizes them up to isomor- 
phism, and any significant mathematical property of the real numbers will be true 
for all isomorphic fields. ‘To be candid I should adiit that this last assertion is just 
a prejudice of the author, but it is one shared by almost all other mathematicians. 
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PROBLEMS 


lL: 


Let f be an isomorphism from F | to Fo. 


(ay Show that £0) = O and fl) = 1. (Mereé0 and 1 on the leftdencte 
elements m Fy, while 0 and 1 on the right denote elements of F%.) 


(b) Show that f(—a) = =—f(a) and f(a7!) = f(a)7!, for a 4 0. 


Here is an opportunity to convince yourself that any significant property of 
a field is shared by any field isomorphic to it. The poimt of this problem ts 
to write out very formal proofs until you are certain that all statements of 
this sort are obvious. Fy and F2 will be two fields which are isomorphic; for 
simplicity we will denote the operations in both by + and +. Show that: 


(a) If the equation x” +1 = 0 has a solution in F), then it has a solution 
in Fp). 

(b) If every polynomial equation x” + a,—; °x"~! +--+ + a9 = 0 with 
dQ, ---,@,-, m Fy), has a root in Fj, then every polynomial equation 
x" +b, 10x"! +--+ + bg = 0 with bo, ..., b,_; in > has a root in Fy. 


(c) If 1 +---+ 1 (summed m times) = 0 in Fy, then the same is true in F>. 
(d) If Fy and F> are ordered fields (and the isomorphism /f satisfies f(x) < 


f(y) for x < y) and F is complete, then Fy 1s complete. 


Let f be an isomorphism from F, to Fy and g an isomorphism from F 
torgeas Wefine the funchonsg.c 7 fromieh) to" heby (ew 0.) — 2, ea 
Show that go f is an isomorphism. 


Suppose that F is a complete ordered field, so that there is an isomorphism f 
from R to F. Show that there is actually only one isomorphism from R 
to F. Hint: In case F = R, this is Problem 3-17. Now if f and g are two 
isomorphisms from R to F consider g ! o f. 


Find an isomorphism from C to C other than the identity function. 


SUGGESTED 
READING 


A man ought to read 

just-as inclination leads him; 
Sor what he reads as a task 
will do him little good. 


SAMUEL JOHNSON 


One purpose of this bibliography is to guide the reader to other sources, but the 
most important function it can serve is to indicate the variety of mathematical 
reading available. Consequently, there is an attempt to achieve diversity, but no 
pretense of bemg complete. ‘Vhe present plethora of mathematics books would 
make such an undertaking almost hopeless in any case, and since I have tried to 
encourage Independent reading, the more standard a text, the less likely it is to 
appear here. In some cases, this philosophy may seem to have been carried to 
extremes, as some entries in the list cannot be read by a student just finishing a 
first course of calculus until several years have elapsed. Nevertheless, there are 
many selections which can be read now, and I can’t believe that it hurts to have 
some idea of what les ahead. 

For most references, only the title and author have been given, since so many of 
these books have gone through numerous editions and printings, often having gone 
out of print at some pomt only to be resurrected later on by a different publisher 
(often as an inexpensive paperback by the redoubtable Dover Publications or by 
the Mathematical Association of America). More exact information really isn’t 
necessary, since it is Now so easy to search for books on-line at Amazon.com and 
other sites. 

+ is used to indicate books whose availability, either new or used, is problematical. 
Author and title searches may turn up other intriguing books by the same author, 
or other books with similar titles. In addition, many of these books will still be 
found in well-stocked academic libraries, perhaps the best place of all to search; 
despite the convenience of the internet, nothing matches the experience of an 
actual (as opposed to a virtual) hbrary, with books stacked according to subject, 
awaiting serendipitous discovery. 


One of the most elementary unproved theorems mentioned in this book is the 
“Fundamental Theorem of Arithmetic”, that every natural number can be written 
as a product of primes in only one way. This follows from the basic fact alluded 
to on page 444, a proof of which will be found near the beginning of almost 
any book on elementary number theory. Few books have won so enthusiastic an 
audience as 


[1] An Introduction to the Theory of Numbers, by G. H. Hardy and E. M. Wright. 
‘Two other recommended books are 


+ [2] Al Selection of Problems in the Theory of Numbers, by WW. Sierpinski. 
[3] Three Pearls of Number Theory, by A. Khinchin. 


The Fundamental Theorem also apphes in more general algebraic settings, see 


references [33] and [34]. 


The subject of irrational numbers straddles the fields of number theory and 
analysis. An excellent introduction will be found in 


[4] /rrational Numbers, by 1. M. Niven. 
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‘Together with many historical notes, there are references to some fairly elementary 
articles m journals. There is also a proof that 7 is transcendental (see also [59]) 
and, finally, a proof of the “Gelfond-Schneider theorem”: If a and b are algebraic, 
with a 4 0 or 1, and b is irrational, then a? is transcendental. 


All the books listed so far begin with natural numbers, but whenever necessary 
take for granted the irrational numbers, not to mention the integers and rational 
numbers. Several books present a construction of the rational numbers from the 
natural numbers, but one of the most lucid treatments is still to be found in 


[5] Foundations of Analysis, by E. Landau. 
While many mathematicians are content to accept the natural numbers as a nat- 
ural starting point, numbers can be defined m terms of sets, the most basic starting 


point of all. A charming exposition of sect theory can be found in a sophisticated 
little book called 


[6] .Nawe Set Theory, by P. R. Halmos. 
Another very good introduction is 
[7] Theory of Sets, by E. Kamke. 


Perhaps it ts necessary to assure some victims of the “new math” that set theory 
does have some mathematical content (in fact, some very deep theorems). Using 
these deep results, Kamke proves that there is a discontinuous function f such 
that f(x + y) = f(x) + f(y) for all x and y. 


Inequalities, which were treated as an elementary topic m Chapters | and 2, 
actually form a specialized field. A good elementary mtroduction is provided by 


[8] Analytic Inequalities, by N. Kazarinoff. 


‘Twelve different proofs that the geometric mean is less than or equal to the arith- 
metic mean, each based on a different principle, can be found in the beginning of 
the more advanced book 


[9] An Introduction to Inequahtes, by F. Beckenbach and R. Bellman. 
The classic work on mequalities is 
[10] /nequahties, by G. H. Hardy, J. E. Littlewood, and G. Polya. 
Each of the authors of this triple collaboration has provided his own contribution 


to the sparse hterature about the nature of mathematical thinking, written from a 
mathematician’s pout of view. My favorite is 


[11] at Afathematicran’s Apology, by G. FH. Hardy. 
Litthewoocd’s anecdotal selections are enutled 


+ [12] A Mathematicran’s Nscellany, by J. 12. Litkewood. 
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Polya’s contribution 1s pedagogy at the highest level: 


[13] Wathematics and Plausible Reasoning (Vol. 1: Induction and Analogy in Mathematics: 
+ Vol. I: Patterns of Plausible Inference), by G. Polya. 


Geometry is the other main field which can be considered as background for 
calculus. Though Euchid’s Elements is stll a masterful mathematical work, greater 
perspective is supplied by some more modern texts, which examine foundational 
questions, non-Euchdean geometry, the role of the “Archimedean axiom” in geom- 
etry, and further results from “classical geometry”. Of the following three books, 
the first, listed m previous editions of this book, has probably been supplanted by 
the later ones, which cover some more advanced material, and perhaps require a 
litle more sophistication on the part of the reader. 


+ [14] Elementary Geometry from an Advanced Standpoint, by E. Moise. 
[15] Huchdean and Non-Euclidean Geometnes, by M. J. Greenberg. 
[16] Geometry: Euclid and Beyond, by R. Hartshorne. 


In addition, all sorts of fascinating geometric things can be found in 
[17] Introduction to Geometry, by H. S. Coxeter. 
Almost all treatments of geometry at least mention convexity, which forms an- 


other specialized topic. [ cannot imagine a better introduction to convexity, or a 
better mathematical experience im general, than reading and working through 


+ [18] Conver Figures, by 1. M. Yaglom and W! G. Boltyanski. 


This book contains a carefully arranged sequence of definitions and statements of 
theorems, whose proofs are to be supphed by the reader (worked-out proofs are 
supplied in the back of the book). Its current unavailability is perhaps a testament 
to the lack of interest in working through exercises, which might also apply to 
another geometry book modeled on the same principle: 


+ [19] Combinatorial Geometry in the Plane, by H. Hadwiger and H. Debrunner. 


Along with these two out-of-the-ordinary books, I might mention an extremely 
valuable lithe book, also ofa specialized sort, 


[20] Counterexamples in Analysis, by B. Gelbaum and J. Olmsted. 
Many of the example in this book come from more advanced topics im analysis, 
but quite a few can be appreciated by someone who knows calculus. 

Of the mfinitude of calculus books, two are considered classics: 


1] A Course of Pure Mathematies, by G. H. Hardy. 
2| Differential and Integral Calculus (two volumes), by R. Courant. 
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Courant is especially strong on applications to physics. There is also a more mod- 
ern update 


[23] Introduction to Calculus and Analysis, by R. Courant and FE John. 


Speaking of applications to physics, an elegant exposition of the material in 
Chapter 17, together with much further discussion, can be found in the article 

[24] On the geometry of the hepler problem, by John Milnor; in The American Mathe- 

matical Monthly, Volume 90 (1983), pp. 353-365. 

(In this paper the curve c’ of Chapter 17 is denoted by v. and the derivative of 
the important composition v o 67! (page 334) is introduced quite off-handedly as 
dv/d@.) A “straight-forward” derivation of Kepler’s laws, together with numerous 
references, can be found in another article in this same journal, 

[25] The mathematical relationship between hepler’s laws and Newton’s laws, by 


Andrew ‘T) Hyman; in The American Mathematical Monthly, Volume 100 


CES ay ape 32-9 36: 


The later parts of Volume I of Courant contain material usually found im ad- 
vanced calculus, including differential equations and Fourier series. An introduc- 
tion to Fourier series (requiring a little advanced calculus) will also be found in 


[26] An Introduction to Fourier Series and Integrals, by R. Secley. 
The second volume of Courant (advanced calculus in earnest) contams addi- 


tional material on differential equations, as well as an introduction to the calculus 
of variations. A widely admired book on differential equations 1s 


[27] Lectures on Ordinary Differential Equations, by W. Hurewicz. 
A good example of new approaches and new topics is provided by 


[28] Differential Equations, Dynamical Systems, and An Introduction to Chaos, 
by M. Hirsch, 8. Smale, and R. L. Devaney. 


[ will bypass the more or less standard advanced calculus books (which can easily 
be found by the reader) smce nowadays the presentation of advanced calculus for 
mathematics students is based upon linear algebra. One of the first treatments of 
advanced calculus using linear algebra is the very nice book 


+ [29] Calculus of Veetor Functions, by R. WH. Crowell and R. E. Wilhamson. 
More recent books to be recommended are 


[30] Advanced Calculus of Several Vanables, by C. H. Edwards, Jr. 
[31] Afultivariable Mathematics, by ‘V. Shifrin. 


And of course 1 am still partial to an older text 


[32] Calculus on Manifolds, by M. Spivak. 


Suggested Reading 613 


‘There are three other topics which are somewhat out of place in this bibli- 
ography because they are gradually becoming established as part of a standard 
undergraduate curriculum. ‘The purposeful study of fields and related systems is 
the domain of “algebra.” Two excellent texts are 


[33] Algebra, by Michael Artin. 
[34] Abstract Algebra, by D. Dummit and R. Foote. 


For “complex analysis”, the promised land of Chapter 27, the classical text is 
[35] Complex Analysis, by L. Ahlfors. 


Rather revolutionary when it was first published, it might now be considered some- 
what old-fashioned, and you might prefer the second m a series of books (3 and 
counting) that have appeared more recently: 


[36] Fourer Analysis: An Introduction, by E. Stein and R. Shakarchi. 
[37] Complex Analysis, by E. Stein and R. Shakarchi. 
[38] Real Analysis, by E. Stem and R. Shakarchi. 


And, since the topic of “real analysis” [high-octane Calculus] has been broached, 
two classics should be mentioned. The first, affectionately known as “baby Rudin”, 
was the source of several problems that appear in this book. 


[39] Principles of Mathematical Analysis, by W. Rudin. 
[40] Functional Analysis, by \W. Rudin. 


The subject of “topology” has not been mentioned before, but it has really been 
in the background of many discussions, since it is the natural generalization of the 
ideas about limits and continuity which play such a prominent role in Part II of 
this book. ‘The standard text is now 


[41] Topology, by J. R. Munkres. 
For the related field of “differential topology”, see 


[42] Differential Topology, by V. Guillemin and A. Pollack. 


The next few topics, ranging from elementary to very difficult, are included 
in this bibhography because they have been alluded to in the text. he gamma 
function has an elegant little book devoted entirely to its properties, most of them 
proved by using the theorem of Bohr and Mollerup which was mentioned in Prob- 


lem 19-40: 
+ [43] The Gamma Function, by E. Artin 


The gamma function 1s only one of several important improper integrals in math- 
. fs : 5 ioe! mee! as 
ematics. In particular, the calculation of J) e~* dx (see Problem 19-42) is impor- 
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tant in probability theory, where the “normal distribution function” 


ji 


G(s) = ie dy 


l : 
| a 
V2n J—co 
plays a fundamental role. A classic book on probability theory is 


[44] An Introduction to Probability Theory and Its Applications, by W. Feller. 


The impossibility of integrating certain functions in elementary terms (among 
them: (OR e-*) is a fairly esoteric topic. A discussion of the possibilities of 
integrating in elementary terms, with an outline of the impossibility proofs, and 
references to the original papers of Liouville, will be found in 


[45] The Integration of Functions of a Single Variable, by G. H. Hardy. 


The basically algebraic ideas behind the arguments were made much clearer over 
a hundred years after Liouville’s work, in the paper 


[46] On Liousville’s Theorem on functions with elementary integrals, by M. Rosenlicht; m 
Pacific Journal of Mathematics, Volume 24, No. | (1968), pp. 153-161. (Also 


available on-line: go to projecteuclid.org and search for Rosenlicht.) 
For a good overview of the subject, and some more recent developments, see 


[47] Integration in finite terms: the Liousville theory, by 'T; Kasper; mm Afathemates 
Magazine, Volume 53, No. 4 (1980), pp. 195-201. 


Reference [46] makes use of the notions of “differential algebra”, a field in which 
a related but seemingly more difficult problem had been solved earlier: ‘There are 
simple differential equations (y” + xy = 0 is a specific example) whose solutions 
cannot be expressed even in terms of indefinite integrals of elementary functions. 
This fact is proved on page 43 of the (60-page) book: 


+ [48] An Introduction to Differential Algebra, by 1. Kaplansky 


A few words should also be said in defense of the process of integrating m 
elementary terms, which many mathematicians look upon as an art (unlike differ- 
entiation, which is merely a skill). You are probably already aware that the process 
of integration can be expedited by tables of indefinite integrals. ‘There are several 
books containing extensive tables of integrals (and also tables of series and prod- 
ucts), but for most integrations it suffices to consult one of the fairly extensive tables 
of indefinite integrals that are available on-line, for example, at sosmath. com, and 
at wikipedia.org, with its ever-expanding source of generally definitive entries for 
mathematics and physics. 


The remaining references are of a somewhat diflerent sort. “They fall mto three 
categories, of which the first is historical. 


For the history of calculus itself, a1 excellent comprehensive source, filled with 
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detailed explicit examples, rather than generalized descriptions, is 
[49] The Historical Development of Calculus, by C. H. Edwards, Jr. 


Some historical remarks, and an attempt to incorporate them into the teaching of 
calculus, will be found in 


[50] The Calculus: A Genetic Approach, by O. Toeplitz. 
An admirable textbook on the history of mathematics in general 1s 
[51] An Introduction to the History of Mathematics, by H. Eves. 


As might be inferred from the quotation on page 39, the basic idea for constructing 
the real numbers is derived from Dedekind, whose contributions can be found in 


[52] ssays on the Theory of Numbers, by R. Dedekind. 


‘he most important notions of set theory, especially the proper treatment of infinite 
numbers, were first introduced by Cantor, whose work is reproduced in 


[53] Contributions to the Founding of the Theory of Transfinite Numbers, by G. Cantor. 
The letter of H. A. Schwarz referred to in Problem 11-69 will be found in 
1 [54] Ways of Thought of Great Mathematicians, by H. Meschkowski. 


Finally, a great deal of interesting historical material may also be found on-line at 
the site www-groups.dcs.st-and.ac.uk/~history/ 


The second category in this final group of books might be described as “pop- 
ularizations.” ‘Vhere are a surprisingly large number of first-rate ones by real 
mathematicians: 


[55] What is Mathematics?, by R. Courant and H. Robbins. 

[56] Geometry and the Imagination, by D. Hilbert and S. Cohn-Vossen. 

[57] The Enjoyment of Mathematics, by H. Rademacher and O. ‘Toeplitz. 
+ [58] Famous Problems of Mathematics, by H. Tietze; Graylock Press, 1965. 


One of the most renowned “popularizations” 1s especially concerned with the 
teaching of mathematics: 


[59] Elementary Mathematics from an Advanced Standpoint, by F. Klemm (vol. 1: Arth- 
metic, Algebra, Analysis; vol. 2: Geometry); Dover, 1948. 


Volume | contains a proof of the transcendence of 2 which, although not so ele- 
mentary as the one in [4], is a direct analogue of the proof that e is transcendental, 
replacing integrals with complex line mtegrals. It can be read as soon as the basic 
facts about complex analysis are known. 


The third category is the very opposite extreme— original papers. The difh- 
culties encountered here are formidable, and I have only had the courage to list 
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one such paper, the source of the quotation for Part IV. It is not even in English, 
although you do have a choice of foreign languages. The article in the original 
French is in 


[60] O0uvres Completes d’Abel. 


It first appeared in a German translation in the Journal fiir die reine und angewandte 
Mathematik, Volume 1, 1826. ‘To compound the difficulties, these references will 
usually be available only in university libraries. Yet the study of this paper will 
probably be as valuable as any other reading mentioned here. The reason 1s 
suggested by a remark of Abel himself, who attributed his profound knowledge of 
mathematics to the fact that he read the masters, rather than the pupils. 
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(i) 
(iii) 


(v1) 


la =a ax) =(a7'a)x =} -x =x. 


lu=uain 
D) 2 2 2 5 5 

lit 2? =syepiligr 0" me Sys — (a — y)(x 4"); soreithemet = y = Ox 

x + y =0, that 1s, either x = —y orx = y. 


Replace y by —y in (iv). 


One step requires dividing by x — y = 0. 


A “A & = 
we, FE we Note 
—_e NS NO —e Neg 
te —— 

~~ 


. . . 
~ _ 


—_e 
end < 


A A 

Bee, See 

ws: a=y 
—* 


— 
(=) 
—e 

— 


eee ee 
ne cl + es ° 
~ ee 
Rays 


_ 
SS 


(vii) 


a/b = ab = (ac)(b7'c7!) = (ac)(be)7! (by Gn)) = ac/be. 

(ad + bc)/(bd) = (ad + bc)(bd)~! = (ad + bc)(b='d-!) (by (iii) = 
ab + cd-! =a/b+c/d. 

ab(a~'b~!) — (a -a7')(b . boy =1,soa~!-b7! = (ab)"!. 
(a/b) / (ej) = (a/b)(c/d)7! = (a-bo')(c-d-")“! = (a is "Neus i 
ad(b~!.¢7!) = ad(be)~! = (ad)/(be). 

x<-—l. 

wore eT. 

All x, since x? —2x +2=(¢ —}?4+1. 

x > 3 orx <—2, since 3 and —2 are the roots of x4 x— 6= 0. 
YS or —) <x <3. 

Fees oy 

O@ x < |. 

b—a and d —c are in P, so (b—a) + (d —c) = (b+ d) — (a +c) 1s 
in P. Thus,b+d>a-+te. 

Using (i), —e < —d; then (1) inphes that a+ (—e) <b + (=a): 

(b—a) and —c are in P, so —c(b—a) = ac—bc is in P, that 1s, ac > be. 
Using (iv), a > 0 and a < 1, so a? <a. 

Substitute a for c and b for d im (vi). 

V2 473 — V5 + V7. 

le 3070) Se (ali = [eae 2 a (ale 

vom v a Ss Aa. 

aifa>-—bandb=0: 

—aif a < —band b < 0; 

a+2b if a> —b and b < 0; 

—a —2b if a < —bandb=>0. 

ee x = 0: 

Sy = x2 if x= 0. 


. =i =3, 

—6<x < -2. 

No x (the distance from x to | plus the distance from x. to —I 1s at 
least 2). 

n= 1, —¥. 

(ey)? = Cy) x29? = [xP ly? = Cx Iyl)?5 sittce [xy] and |x| - ly 
are both > OQ, this proves that |xy| = |x| - |y|- 

1/15 = 8S ele ly oye) = [ey (ye Gy — a 

It follows from (av) that |x| = |y — (yy —x)| < |y| + |y —~x|, so |x| -—ly] < 
|e — yl: 

Ix ty +2] < Ix t+yl4 lel < lx] + ly] 4 lel. If equality holds, then 
Ix + y| = |x| +|y|, so x and y have the same sign. Moreover. < must 
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CHAPTER 2 


have the same sign as x + y, so x, y, and z must all have the same sign 
(unless one is Q). 


(i) Simce 1? = 1-(2)-(2-14 1)/6, the formula is true for n = 1. Suppose 
that the formula is true for k. ‘Then 


yi 
Pe ee et = EE ety 


bese) 


[k(2k + 1) + 6(k + 1)] 


Gee» 
"PETG 

Ue Ole ae Ns 
pie eec cies a ee 


[(K + 2)(2k + 3)] 


so the formula is true for k + 1. 


Y@i - 1) =14345+4+---4+@n-1 
i) 


= 1 2 3 2 — 2) 
. (2n)(2n + 1) 


5) —n(n+ 1) 
=n’. 
(a) Since 
Nea 
l= 3 
l-—r 
the formula is true for n = |. Suppose that 
] —r"t! 
Ler 2 
1—r 
‘Then 
J —r"t! 
(eee tt ghtt = 4 prt 
—r 
7 ee prt 4 ntl] —r) 
= l—r 
J — rtt2 
“wie 


(b) 
S=1l4+r+---+r" 
rsS= ALS pea 
‘Thus 
Sd =n) =S=—rS=lor 


ese 
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sO 


i — pitl 
S = ———— 
l1-—r 
(i) From 
(kK+1)*— 4 = 4k? 4 6k? 4 4k +1, k=1,..., n 


we obtain 


(at I -1=4S°R 46S 445 kn. 
k=1 k=] k=] 


SO 
; Greaiitks. amie eae eee) (a 
ye = ee 
4 
ll 
ul geet Ca 
= © va 4 
(ui) From 
l | ] 


= i — | ere n 


ee) Oe 
we obtain 
| : | 
nt] 2, k(k +1)" 
1 is either even or odd, in fact it is odd. Suppose » is either even or odd; 
then 2 can be written either as 2k or 2k + 1. In the first case n + 1 = 2k +1 
is odd; in the second case n + 1 = 2k + 1+ 1 = 2(k + 1) is even. In either 
case, n + 1 1s either even or odd. (Admittedly, this looks fishy, but it 1s really 
GOLreGt: ) 
Let B be the set of all natural numbers / such that 7g — 1 +/ is in A. Then 
lis in B, and/ +1 is n B if / is in B, so B contains all natural numbers, 
which means that A contains all natural numbers > no. 
(a) Yes, for if a+ were rational, then b = (a+b) —a would be rational. If 
a and b are irrational, then a + b could be rational, for b could be r — a 
for some rational number r. 
(b) If a =0, then ab is rational. But if a 4 0, then ab could not be rational, 
for then b = (ab) - a! would be rational. 
(c) Yes; for example, V2. 
(d) Yes; for example, / and =) 2. 


(a) Since 
(3n + i —"On- = on ll = 3(Gneee 2n) +1, 
(3n+ oe — On? +127n+4= 3(3n? +4n+1)4+1, 
it follows that if k* is divisible by 3, then & must also be divisible by 3. 


Now suppose that V3 were rational, and let V3 = p/q where p and 
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No 


(b) 


q have no common factor. Then p* = 3q?, so p? is divisible by 3, so 
p must be. Thus, p = 3p’ for some natural number p’, and conse- 
quently (3p’)? = 3q7, or 3(p’)? = q*. Thus, g is also divisible by 3, a 
contradiction. 

The same proofs work for V5 and V6, because the equations 


2 

(5n +2)? = 25n2 + 20n +4 = 5(5n? + 4n) +4, 
(5n +3)? =2 
2 


and the corresponding equations for numbers of the form 6” + m, show 
that if k? is divisible by 5 or 6, then & must be. The proof fails for V4, 
because (4n + 2)? is divisible by 4. (For precisely this reason this proof 
cannot be used to show that in general Ja is irrational if a is not a 
perfect square ~ we have no guarantee that (an +m)? might not be a 
multiple of a for some m < a. Actually, this assertion 7s true, but the 
proof requires the information in Problem 17.) 
Since 

(2n + i? = $n? + 12n? +6n + 1 = 2(4n? + 6n? + 3n) + I, 
it follows that if k? is even, then k is even. If V2 = p/q where p and 
g have no common factors, then p? = 2q?, so p? is divisible by 2, so p 
must be. Thus, p = 2p’ for some natural number p’, and consequently 
(2p’)? = 2q3, or 4(p')> = q?. Thus, gq is also even, a contradiction. 


¢ aj . : . - . 
The proof for V3 is similar, using the equations 


(Bye ye = 97ne 277 On + PBN? + On2.4 3h) + 1. 
(Gree) = 7 5497 360 + 8 = 3ns el Se ee 


li w= bithen (yh) = li wh. Supposethat (P+h)” = 1 -paA. Then 


(I 


kor 


Ey reer Pfr)” > (1 +h) Pek), @ since 1] EAS 0 
=!4(n+))hAt+nh? >l+tamt+)h. 


h > 0, the inequality follows directly from the binomial theorem, since 


all the other terms appearing in the expansion of (1 + /)" are positive. 


(x + 1)/(x +2); the expression f(f(x)) makes sense only when x # —1 
and x # —2. 

1/Ci + cx) (for x #4 —1/c if c 40). 

(x+y4+2)/@+ 1+ PD (for x, y 4-1). 

Only c= lesince f(x) = f(cx) imphes thats — exo and tins maust be 
truefor atleast one x 4 0, 

y > 0 and rational, or y > |. 

Up 

hy Opeley 
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1) eS Seay 
(Gu) “eee Nandias=— 2) 
v) &. 
1) 229. 
ili) 22sint 4 sin(2'), 
(Pars: 
Lit) {Sens 
Vv PZOvRA 
vil) sososoPoPoPos. 
a) y. 
b) H(y). 
(c) H(y). 
(a 
even odd 

odd neither odd 

(b) 
even odd 
even 
odd odd even 

(Cc) 


f even f odd 


g even 


g odd 


even 


(d) Let g(x) = f(x) for x => 0 and define g arbitrarily for x < 0. 

(a) Let g@)\=)2@3)¥= Iand let f be a function for which f@) 4 f() + 
fC). Then fo(g +h) F# fogtf oh. 

(b) [(g+h)o f](@) = (g+h)(f@)) = a(f)) +h(F@)) = (go f)@)+ (ho 
P(x) = [(g 0 f) + (ho fy). 

| 1 1 l 

(c) Foe = FOG) = 7 8) ~ (< 7) (@): 

(d) Let g(x) = 2 and let f be a function for which fG) RQ). hen 
I/(f og) # f o(1/g). 
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6. 


Me 


(a) 


(111) 
(iv) 
(a) 


(2x4): 

(a —&,a-+ €). 

i—23 2). 

(=6o,al | U'| I, oo). 

All points below the graph of f(x) = x. 

All points below the graph of f(x) = x7. 

All points between the graphs of f(x) =x+ 1 and f(v¥)=+«—- 1. 

A collection of straight lines parallel to the graph of f(«) = —., inter- 

secting the horizontal axis at the points (7, 0) for integers 7. 

All points inside the circle of radius | and around (1, 2). 

A square with vertices (1,0), (O, 1), (—1, 0), and (0, —1). 

The union of the graph of f(x) =x and of f(x) =2-—-x. 

The point (0, 0). 

The circle of radius V5 around (120), Sines 4) wi2 ete We =(x—-1)*+ 

8 
Simply observe that the graph of f(x) =m(x —a)+b = mx + (b—ma) 
is a straight line with slope m, which goes through the point (a, b). (The 
important point about this exercise ts simply to remember the point slope 
form.) 
The straight line through (a,b) and (c,d) has slope (d — b)/(c¢ — a), so 
the equation follows from part (a). 
When m =m’ and b ¥ b’. In that case, there is clearly no number x with 
f(x) = g(x), while such a number x always exists if mm 4 m’, namely, 
x = (b' — b)/(m — 1m’). 
If B = 0 and A ¥ O, then the set is the vertical straight lme formed 
by all points (x, y) with x = —C/A. If B # O, the set is the graph of 
tay DB) x (—OPAY 
‘Lhe points (x, y) on the vertical line with x = a are precisely the ones 
which satisfy 1 -.+0-y + (—a) = 0. The points (x, y) on the graph of 
f(x) =mx-+D are precisely the ones which satisfy (—m)x+1-y+(—b) = 


The graph of f is svmmetric with respect to the vertical axis. 
The graph of f is symmetric with respect to the origin. Equivalently, 
the part of the graph to the left of the vertical axis is obtained by re- 
flecting first through the vertical axis, and then through the horizontal 
AXIS, 
The graph of f les above or on the horizontal axis. 
The graph of f repeats the part between O and a over and over. 

The square of the distance from (x, x2) to (0, ) is 
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(b) 


(ii) 
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which is the square of the distance from (x, x*) to the graph of g. 
The point (x, y) satisfies this condition if and only if 


(x — a)? + (Gy = Bp) =(y- yy’, 
or 


x? —2ax+a7+ Wa — 2By + B° = We =—2yy+ Ma 


=(Goa)PtH(y Jes pe aEENE 
P28 S27) ye B= ay 


If 6 =y, so that P is on the line L, then the solution is the vertical line 
through P. 


or 


—&§ > 
= lim(x* + 2x + 4) = 12... 
=) se) 


n 71 


‘ = _9 me =. 
— lim x” Ly yn oy oes ey Se ie 1 


x>y xX —y x>y 


_ yor we seas teh gees wees = nye. 


J/ath—Ja i (Jath—Ja)\(Vat+th+VJa) 
$$ = kn X Ss 
h—0 h h-0 h(i/ath+ Ja) 
| 
= im ———— 
h>0 /atho+ Ja 
1 

= aE 

1 = 0. For all x we have | cos(x7)| < 1, so |3 — cos(x~)| < 4, and thus 
| f (e) — O| = |x] - |3 — cos(x7)| < 4- [x]. 

So we can take 6 = €/4. 
1 = 100: We have 


ee 109 = 00). 


Xx 


| ] 
== 1 = 100- jx = 


bg |x| 


The initial stipulation |x — 1| < 5 makes x > 4, so 1/|x| < 2, so we 
then have 


| f(x) — 100] < 200: |x — 1). 
So we can take 6 = min(1/2, ¢/200). 
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1 = 2. ‘The same sort of argument that was used in the text and in 
number (ni) shows that 


| : : 
—-—1| <e for 0 < |x —1| < 6; = min(1/2, €/2), 
x 
so that 
E E 
—-l||< i for O < |x — 1| < 6; = mmn(1/2, €/4). 
% 2 


Similarly, the solution to number (iv) gives a 69 such that 
lg? =3 [m= for O18 | xl | Bend 


and we have a corresponding 43. ‘Chen we can take 6 = min(6}, 49). 


(ai) 7=0, Let 6 = e?. 


(1) 


(111) 


We need | f(x) — 2| < e/2 and |g(x) —4| < e/2, so we need 
ay 


9) 
; o iP eS e~ 
OQ < |x — 2| < min [ sin~ 36 + Pal De 


We need 


aS 
Seb 
Ti 
ma. 


|g(~) — 4| < min 


so we need 


0 < |x —2| < [min(2, 8e)]? = 6. 


Let / = lm f(x) and define g(t) = f(a +h). Then for every ¢ > 0 there is 


A= a 


a 6 > O such that, for all x, if 0 < |x —a| < 6, then |f@) —7d < «|. Now if 

0 < |h| < 6, then 0 < |(4+a)—a| < 6,so|f(a+h) —1| < ¢. This equality 

can be written |g() —1| < e. Thus, im g(h) =1, which can also be written 
h— 


hm f(a+h) =1. The same sort of argument shows that if lim f(a+h) =m, 
h> ; h-0 


then lim f(x) =m. So either limit exists if the other does, and in this case 


PS age 


they are equal. 


(a) 


(b) 


Intuitively, we can get f(x) as close to / as we like if and only if we can 

get f(x) —/ as close to 0 as we like. The formal proof is so trivial that it 

takes a bit of work to make it look like a proof at all. To be very precise, 

suppose lim f(x) = / and let g(x) = f(x) —1. Then for all ¢ > 0 there 

Xa 

is a 0. > eich that, for alla, ft O = |x —g@l=— 5, then [7 G)—e| = €. 

g(x) —O| < €, so lim g(x) = 0. The 
Aid él 

argument in the other direction is similarly uninteresting. 


This last equality can be written 


Intuitively, making x close to a is the same as making x — a close to 0. 
Formally: Suppose that lm f(x) = J, and let gv) = f(x — a). Then 
Xd 


for all ¢ > O theré is :a 6 > O such that, Tor -allix, af O < lx — al <5, 
then | f(x) —/1| < e. Now, if 0 < |y| < 6, then O < [(7 + 4) —a] < 6, so 


We 


N 
A) 


2m 


30. 
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| f(y +a) —1| < e. But this last inequality can be written |g(y) —1| < é. 
So lm g(y) =/. The argument in the reverse direction 1s similar. 
y>0 


c) Intuitively, x is close to 0 if and only if x? is. Formally: Let lim f(x) = 
} y y ae 


l. bor every € > 0 there is a™ > © such that {10 =< (el, <ao ethan 

|f(x) —1| < e. Then if 0 < |x| < min(1,8), we have 0 < |x?] < 8, so 

lf @?) — i < 6. Thus, lim f(x) =/. On the other hand, if we assume 
x30 


that lim fix) exists, say lim 7G) = m, then forall « > O there is a 6 
x—0 


Scena iO < Ik| < $, then |fG@-) —m| <e. Then #0 < ire ce 
we have 0 < |2/x| < 8, so IFC eID) —m| < é, or | f(x) —m| < e. Thus 


hint fx 8. 
x 0 


(dq) ete Ca Ptory >"O) and j @&)— —1 for x = 0) Them him Ge) =e 


but lim f(x) does not exist. 
) 


Aes 

(a) The function f(«) = 1/x cannot approach a hmit at 0, since it becomes 
arbitrarily large near 0. In fact, no matter what 6 > O may be, there 
is some x satisfyng O < |x| < 6, but I/x > |/| +e, namely, any x < 
min(6, 1/(|/| + €)). Any such x does not satisfy |(1/x) —))| < e. 

(b) No matter what 5 > 0 may be, there is some +x satisfying 0 < |x —1| <6, 
but 1/(w — 1) > |/| +e, namely, any x < min(I + 6,1 + 1/({/| + €)). 
Such an x does not satisfy |1/(x — 1) —/| < e. (It 1s also possible to apply 
Problem 10(b): hm | bis 1/(x — 1) if the latter exists, so this limit 
does not exist, Wecatice of part (a).) 

(i) ‘This is the usual definition, simply calling the numbers 6 and e, instead 

of € and 6. 

(i) This is a minor modification of (i): if the condition is true for all 6 > 0, 
then it applies to 6/2, so there is an € > O such that if 0 < |x ~—a| <e, 
tlaen 7 (4) —7| = 0/2 <0. 

(in) “This is a similar modification: apply it to 6/5 to obtain (1). 

(iv) ‘This is also a modification: it says the same thing as (1), since €/10 > 0, 
and it is only the existence of some € > O that is in question. 

Wr lim fey — tw f (x)= lL, then for every > Outhene are djxdon> Oisuch 

i Clie 


Xa 


that, for all x, 


ifa <x <a+6,, then | f(x) —-1| <e, 
ifa—d. <x <a, then |f(x)—-/| <e. 


Let 6 = min(6;, 52). If 0 < |x —a| < 4, then either a — 565 <a—8 <x <a 
or elsea <x <a+6<a+46, so|f(x)—-1| <e. 
Che iim, f(x), then for all ¢ > 0 there is a 6 > O such that | f(x)—l| < 


lor0 = 6, If =o = 2 — 0) hem = ee so yea | ee 
‘Thus im f(—x) = 1. Similarly, if iim jG) exists, then “Tin fC) 


hi Ac—2 


exists and has the same value. (Intuitively, x 1s close to 0 and positive if 
and only if —x 1s close to 0 and negative.) 
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10. 


Cr him f(x), then for alle > O there is a 6 > O such that | f(x)—l| < 
efor 0 < x < 5. Soif 0 < |x| < 4, then (f(x) =i) =< e. Whus 
hm f(x|) =1. The reverse direction is similar. (Intuitively, if x is close 
to 0, then |x| is close to 0 and positive. } 


(an) olf fee hm, f(x), then for alle > O there isaé > Osuch that | f(x)—l| < 


efor0 <x <3. If 0 < |x| < V6, then 0 < x? <6, s0 Wee Fl ee. 
‘Thus lim f(x) = 1. ‘The reverse direction is similar. (Intuitively, if x 
x= 
is close to 0, then x? is close to 0 and positive.) 
If/ = lm f(x), then for every ¢ > 0 there is some N such that | f(x)—l| < 
X=? CO 
for x > N, and we can clearly assume that N > 0. Now, if 0 < x < I/N, 
then al yc > Neso | fGl/m— A= eclims hny 7 dyx) 2, The reverse 
x—O0t+ 


direction is similar. 


(1) Pix) — se +2 for all 
ite C—O for, all x. 


@) Bounded above and below: minimum value 0; no maximum value. 

Gu) Bounded below but not above: minimum value 0. 

(v) Bounded above and below. If a < —1/2, then a < —a—1,so0 f(x) = 
a+2 for all x n (—a—1,.a+1),so a+2 1s the maximum and minimum 
value. If —1/2 < a < 0, then f has the minimum value a’, and if 
a > 0, then f has the mmimum value 0. Since a +2 > (a + 1)? only 
for (-1 _ V5) /2 <a<(-l1+ V5 )/2, when a > —1/2 the function f 
has a maximum value only for a < (—1 + V5 )/2 (the maximum value 
being a + 2). 

vil) Bounded above and below; maximum value 1; minimum value 0. 


ix) Bounded above and below; maximum value 1; minimum value —1. 


) k= —2yanee ((—2):<=0:-< f(—]). 

iii) m=-—Il, since f(—1) =—-1 <0 < f(0). 

i) At (Gee 1687 (lee sin?.x) — 119, then f is continuous on 
Rand f(2) > 0, while f(—2) < 0, so f(x) = 0 for some x in (—2, 2). 


f is constant, for if f took on two different values, then f would take on all 


(xi) f has a maximum and minimum value, since f 1s conunuous. 
( 
( 


values in between, which would include irrational values. 
ay “fOSse 

Qf O) =a 

(3)0 _f@) Sap 

(4) f(x) =-ly, 

Apply Theorem | to f — g. 


CHAPTER 8 


i) 


10. 


IS: 
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lf 7(0) = 0 or (@) = de chasse x = 0 or deliani) = 0 = 1(0) and 
fC) < 1=/()), then Problem 10 applied to f and / implies that f(x) = x 


for some x. 


(i) 1 is the greatest element, and the greatest lower bound is 0, which is 
not in the set. 

(iu) 1 is the greatest element, and 0 is the least element. 

(vy) Since {x :x?-+x+1 > 0} = R, there is no least upper bound or greatest 
lower bound. 

(vi) yoinge (a2 x = Oyand x? ey ee) = ee J5 4/2. QO), the greatest 
lower bound is [—1 — J5 |/2. and the least upper bound is 0; neither 
belongs to the set. 

(a) Since A # Y, there is some x in A. Then —x is in —A, so —A F &. 

Since A ts bounded below, there is some y such that y < x for all x in 
A. Then —y > — x for all x in A, so —y > z for all z in —A, so —A is 
bounded above. Let @ = sup(—A). Then @ is an upper bound for —A, 
so, reversing the argument just given, —@ is a lower bound for A. 

Moreover, if 6 is any lower bound for A, then —f is an upper bound for 
—A,so —B = a, so"B < —a. Thus —e@ is the’greatest lower bound for A. 

(a) If/is the largest integer with / <x, then/+1 > x, but/+1<x+I1<y. 
So we can let k = /+ 1. (Proof that a largest such integer / exists: 
Since N is not bounded above, there is some natural number n” with 
—n <x <n. There are consequently only a finite number of integers / 
with —n </ <x. Pick the largest.) 

(b) Since y — x > O, there is some natural number n with I/n < y — x. 
Since ny — nx > |, there is, by part (a), an integer k with nx <k < ny, 
which means that x <k/n < y. 

(c) Choose r + Hs = 1)/2. 

(d) By part (b), there is a rational number r with x < r < y, and therefore 
a rational number s with x <r <s < y. Apply part (c) tor <s. 

Let k be the largest integer < x/a (the solution to Problem 5 shows that such 

a k exists), and let x’. =x —ka > 0. If x —~ka =x’ >a, then x > (kK + Ia, 

sok +1 < x/a, contradicting the choice of k. SoO <x’ <a. 

(a) Since any y in B satisfies y > x for all x m A, any y in B is an upper 
bound for A, so y > sup A. 

(b) Part (a) shows that sup A is a lower bound for B, so sup A < inf B. 

Since x < sup A and y < sup B for every x in A, and y in B, it follows that 

x+y <supA-+sup B. Thus, sup A + sup B ts an upper bound for A + B, so 

sup(A + B) < sup A+sup B. If x and y are chosen in A and B, respectively, 
so that sup A—x < €/2 and sup B—y < e/2, then sup A+sup B—(x+y) < «. 

Hence, 


Sap Arb) = 1 +p > supa slp — 2 
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re... a aan me 
ON Naeem ee hc 
—] £ l 

a(ath) a2’ 


slim 
h-0 


(b) ‘The tangent line through (a, 1/a) is the graph of 


=] 1 
g(x) = ay Oa G) oe 
a 
a, ee 
— gz a 


Les. oie 
x a 
or 
x* —Vax £07 = 0) 
SOnm— Tae 
2. (a) 
1 1 
as DS a9) 
PO cig tetO='@ _ |) GEM a 
h>0 h h>0 h 
(—2ah — h”) Dy 
== 4100 
h>0 ha?(a +h)? a3 


(b) The tangent line through (a, 1/a7) is the graph of 


2 l 
SO) a Cea 


2S 

> igen 
If fo) = ee). then 

l 2%). 3 

=i ees 
or 

2x? — 3ax? +a? =0, 
or 
0 = (x — a)(2x* — ax — a”) = (x — a)(2x +. a)(x —a). 

So x =a or x = —a/2; the point (—a/2, 4/a7) lies on the opposite side 


of the vertical axis from (a, |/a7). 
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3F 
, Mw faeh)— fey. Van va 
f@ =k ——\—H—— = lm ——— 
h-0 h h—0 h 
h>0 h(J/a+h+Ja) h>0h(/at+h+ Ja) 
l 
——j 2/a 


4. Conjecture: S,/@) = nx"—!. Proof: 


Sn(x +h) — S,(x) - Gh =x 
= hm ——— 


Se |) = hi SSS EB 
(*) 70 h re h 
> Gre: Fn x" 
EA Wl 
—Aiiia 
h>0 h 


n\ ve 7 : _ 
= ie lL px"), since lim h/~! = 0 for j > 1. 
h—> 


5. f'(x) =0 for x not an integer, and f’(x) is not defined if x is an integer. 


6. (a) 


g(x +h) = 8x) _.. LCoS) se Cll = AG) see] 


/ ai l 
Sz) he h h>0 h 
c+th) — fC. 
aa FQ +h) — f@) = f'(x). 
h-0 h 


Cr tate) ee) Cy Ce td) 16) 
EES SS lim = ane) ae 
h h-0 h 
= (ec lim LTD) se) — Cinca)s: 
h->0 h 
Towa) f (9). = 3.99 Co)i 2a) aa (GO) = See) 
b) £'(3*) = f'9) =3-9; f'(S*) = #25) = 3- 25)’; #6?) = f'G6) = 
(36). 


‘(x) = lim 
BAX) my 


2. 
q) fila?) = 302)? = 3a @?) = 3@?)? = 3x 
d) f’(x?) = 3x"; but g(x) = x®, so g’(x) = 6x. 
8. (a) 


SCR OE ee te eee 1) 
h>0 h % h>0 h 
bee Mieoeele) eee) 


= f& + @): 
h>0 h 
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(b) 
; . g(x +h) — g(x) . flex +eh)— flex) 
g (x) = bn. =s Lr MR 
h-+0 h h-0 h 
Cll (Come ch) — a (cx) ih . cl f(cex +k) — flex)| 


= hm ln 
h>0 ch k=0 k 
‘(ex +h) — ficx 
ee Flex +h) — Flew) =c- f'(cx). 
k—0 k 


(Compare the manipulations in this calculation with Problem 5-14.) 

(c) If gx) = f@ + @pthen gi) = f'(« +4), by part {a). But g = f, so 
f'(«) = g'(x) = f(x +a) for all x, which means that f’ is periodic, with 
period a. 

(elie (x) = x, then g’(x) = 5x*. Now f(@) = g(x + 3), so by Prob- 

lem 8(a), f’(x) = g(x +3) = 5(x +: 3)*. And f/x + 3) = 5(x + 6). 

(ii) f(x) = (x—3)°, so f’(x) = 5(x—3)%, as in part (i). And f’(x+3) = 5x74. 

Mle (x) = (x + 2)", so i Cor 7-2) easin part @). And f’(x +3) = 

T(x +5)°. 

If f(&) = g(t+x), then f’(x) = g9’(f++), by Problem 8(a). If f(r) = g@+2x), 

then’ f’(t) = g'(t + x), by Problem 8(a), so f’(x) = g’(2x). 

(ali s@) — ct”, then s’(t) = 2ct, and there is no number & such that 
SG) est) [that ise 2em— Rar" forall e 
(By the way, at this pomt we do not know any nonzero function f for 


which /’ is proportional to f. After Chapter 18 it might be amusing to 
determine what the world would be like if Galileo were correct.) 

(b) . @) If s(t) = (a/2)t?, then s’(t) = at, so s"(t) =a. 

(ii) {s'(t)]? = (at)? = 2a- (a/2)t? = 2as(t). 

(c) The chandelier falls s(t) = 16t7 feet in ft seconds, so it falls 400 feet in 
t seconds, if 400 = 1677, or t = 5. After 5 seconds the velocity will 
be (5) = 5a = 5-32 = 160 feet per second. The speed was half this 
amount when 80 = s‘(t) = 32t, or t = >. 

(a) ‘This is another way of writing the definition (see Problem 5-9). 

(b) ‘This follows from Problem 5-11, applied to the functions @(f) = 
[bisa (a)|/k and BG) =| Am) — (eA. 

(i) fw) = Ox. 

(iii) f"(x) = 4x7. 

(i) means that f’(a) = na"—! if vax) = Xx". 

(iit) MIGANE Ung) — 7a) if eer) ey (x) + c. 

(v) means the same as (ui). 

(vii) means that g’(b) = f'(b +a) if gv) = f(xt+a). 

(ix) “meahS that 2 (>) = ef’ (cb) if g(x) = f(cx). 


(1) (1 + 2x)+ cos(x + Vay, 
(i) (—sin.x)- cos(cos.x). 


COSX —X siIn.v — Gosx 
COs . . 


5 
Ne 
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(vii) (cos(x + sinx))- (1 + cosx). 

(i) — (cos((x + 1)? +2) - [2@ + D@& + 2)+ @F+ 1’). 

(in) [2sm((x + sin x)*) cos((x + sin 1) | -2(x + sin x)(1 + cosx). 

(v) (cos(x sin x)) - (sinx + x cosx) + (cos(sin x)(cos x?)) - 2x. 

(vil) (2 sin x cos x sin x2 sin? x2) + (2x cos x? sin’ x sin? x2) 

+ (4x sin x? cos x? sin? x sin x2). 

Gx) 6@ + sin? cbs) sin? x €OS x): 

(x1) cos(sin’ x +1)! -7(sin! x°- led sin® x7 - cosx’ - 7x°®). 

(xi) cos(x2 + sin(x? + sin x?)) - [(2x + cos(x2 + sin x7) + (2x + 2x cos x7))]. 

(1 + sin x)(2x cos x? - sin? x + sin x2 -2sin x cos.x) — cosx sin x? sin? x 
(1 + sin.x)2 , 


>. 
aM, ve 3 Me 3x2 sin x — x? cos x 
3x“ sin | —— ] — x° cos [ - . | ————|.— 
SIN X sim Xx sin xX 
93 


ane (x + 1)- 
(x +2)? 
(iii) 2x? 
(i) —x?, 
(iii) 17. 
(i) f(x) =8'a@+8@)). 


i) (Gs) — 8 Gr gO) + eG): 
v) f'(®) = g(a). 

Ao errret). omec r (tf) — 4 for that t with r(t) = 6, it follows 
that A’(t) = 22 -6-4 = 48m when r(t) = 6. 
(b) If V(r) is the volume at time f, then V(t) = A4nr(t)?/3, so V’(t) = 

Anr(t)2r'(t) = 4 - 62.4 = 576m when r(t) = 6. 
(c) First method: Since A’(t) = 2a @rt),and A’ (1) = 5 tor 7G) = 3, it 
follows that 
A(t) 


er Zar) 


5 
= when r(t) = 3. 
‘Thus 
V(t) = 4nr(t)7r'(t) 
5 
a So 
m-9 a 
= 30 whenr(r) =3. 
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‘To apply the second method, we first note that if 


fit) = AM?” = VA}, 


then, using Problem 9-3 and the Chain Rule, 


] 
OSA) A 
2/ A(t)? 


| 


STG ee 3A(t)° A(t) 


3 
= 5 AWA) (just as we might have guessed). 


Now 
Anr(t)? _ 4x ROAR 
3 7 3) 
Afar (t)?|*/ 
37/2 
_ 4a? 
Te 


Vo 


So 
4 3 , 
Vv @— PAN) 


37 1/2 


2) 
ae m!/*r(t)A'(t) 


= Do 2)n 5) = 3h), 
10. (i) (foh)'(0) = f'(h(0)) -h’(0) = Ff’) -sin7(sin 1) = 
[6 sin 4 — cos 5] sin? (sin Ly 
(111) a(x?) = h'(x*) - 2x? = sin?(sin (x4 4 1) = 2x2. 
12. The Chain Rule implies that 


if / 
S @)=( o's) Mi=/ €G@)) *e'@) 


pee. 


dz dz a 
35; (a) — = 7 . = = (cos y)- Cl = 2x) =Kcos & aL xe) Dx). 
i Se ee (cosy), (cosy (Con eicasn) 
i ee Se Sid) 2 COSe = $( Sin > (COS 5 
11) aaah Ge ee COS U) - (COS x cos(sin x S 
CHAPTER 11 1. @ O= f’(x) = 3x? — 2x —8 for x = 2 and x = —3, both of which are in 
[-2, 2]; 


sf 203 ss 
maximum = 77 9 minimum = —11. 


N 
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(iit) OR es) R942 + 1x = 12e(x2 = 2x + 1) for » = 0 and 
x = 1, of which only 0 is in [-5. 5]; 
f(-3) = t F(a) = 1 FO) = 0; 


maximum = 8. minimum = 0. 
(vy) O= f= 
x?+1—(@41)2x _ 1-2x-x? 
(x2 + 1)? ) Ges 
fon) =] Sl rand x= = oD. of which only —1 + V2 is in 
tal 
f-)=0, f= f(-14+ V2) = +¥2)/2; 


maximum = (1 + We )/2, mimimum = 0. 


(1) —} 1s a local maximum point, and 2 is a local mmimum point. 

Qi) Ois a local mmimum poimt, and there are no local maximum points. 

(vy) —-I+ V2 is a local maximum pont and — | V2 is a local minimum 
pomt. 


(a) Notice that f actually has a minimum value, since f ts a polynomial 
function of even degree. The minimum occurs at a point x with 


n 
Oe —at (9) = 2 we: — Gi), 
i= 
so X = (ay +---+a,)/n. 

(1) 3 and 7 are local maximum points, and 5 and 9 are local mmimum 
points. 

(it) All irrational x > O are local minimum points. and all irrational + < 0 
are local maximum poits. 

(vy) x isa local minimum point if its decimal expansion does not contain a 5. 
It is a local maximum point if its decimal expansion contains exactly 
one 5 that is followed by an infinite string of 9’s. In all other cases, x is 
both a local maximum point and a local minimum point. 

If f(x) is the total length of the path, then 


a} 9) 9) 4) 
fig) =v x- + aes yy So 
The positive function f clearly hasa minimum, since lim f(x) = hm f(x) 
X00 i> —@ 
= oo, and f is differentiable everywhere, so the minimum occurs at a point 
x wath (x)= 0. Now, f (x) = 0O'when 
Cie) 
= '(). 


Xx 
Vx2-+a2 | oe ae = 


This equation says that cosa@ = cos p. 

It is also possible to notice that f(x) 1s equal to the sum of the lengths of the 
dashed line segment and the Ime segment from (x, 0) to (1, b). This is short- 
est when the two line segments he along a Ime (because of Problem 4-9(b), if 
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ili 


ZA 
28. 


a rigorous reason is required); a little plane geometry shows that this happens 
when @ = B. 

If x is the length of one side of a rectangle of perimeter P, then the length 
of the other side is (P — 2x)/2, so the area is 


x(P — 2x) 
ek ae 


So the rectangle with greatest area occurs when x is the maximum point for f 
on (0, P/2). Since A is continuous on [0, P/2], and A(O) = A(P/2) = 0, 
and A(x) > 0 for x in (0, P/2), the maximum exists. Since A is differentiable 
on (0, P/2), the minimum point x satisfies 


AG) = 


jai = P—2x 


~~ BAX 
= aa 


soa = P/4. 
Let S(r) be the surface area of the right circular cylinder of volume V with 
radius r. Since 


V=ar-h_ where h is the height, 
we have h = V/s’, so 
S(r) = 2nr? + 2nrh 
2V 
= 2nr? + — 
= 
We want the minimum point of S$ on (0, 00); this exists, since lim Si) = 


lim S(r) = oo. Since S$ is differentiable on (0, 00), the mmimum point r 
r—>co 


satisfies 
O= S’'(r) = 4ar — as 
¥) Arr? H2V 
= 3 d 
or 


pas 
7G. 


1 is a local maximum point, and 3 is a local minimum point. 


(a) We have 


fb) = f(a) 


= f'(x) for some x in (a, b) 
b—a 


2M; 


so f(b) — f(a) = M(b—a). 


o>) 
to 


0) 
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We have 


f(b) — f(a) 


= f(x) forsome~x in (a,b) 
b—a 


it, 


so f(b) — f(a) < m(b—a). 
If | f'(x)| < M for all x in [a, b], then —M < f(x) < M, so 


f(@—M(b—a) < f(b) < fia) + Mb —a), 


Ols 


[TD VC) | =O Dice ae) 


f(x) = —cosx +a for some number a (because f(x) = — cosx is one 
such function, and any two such functions differ by a constant function). 
f'(x) = x4/4+4 for some number a, so f(x) = x°/20+ax +b for some 
numbers a and b. 

Ff") = x? + x3/3 +e for some a, so f’(x) = x9 /6+27/12 + ax+b 
for some a and b, so f(x) = x7/24 + x°/60 + ax7/2 + bx + ¢ for some 
numbers a, b, and c. Equivalently, and more simply, f(x) = x ad + 


4 _ 
x°/60 + ax? + bx +c for some numbers a, b, and c. 


Since s"(t) = —32, we have s’(t) = —32t +a for some a@, so s(t) = 
—16t7 + at + B for some a and B. 
Clearly, s(0) = 0+0+4+ 6 and s’(0) =0+a. Thus, aw = vg and B = so. 


In this case, so = 0 and vp = v, so s(t) = —16t2 + vt. The maximum 
valic Of s occurs when 0 = s*@)="—>327-F vor = 0/32. Sonne 
maximum value is 


(5) =—16(z5) +» G5) 
y? 


At that moment the velocity is clearly 0, but the acceleration is —32 (as 
at any time). The weight hits the ground at time ¢ > 0 when 


Oi ae 


or t = v/16 (it takes as long to fall back down as it took to reach the top). 
The velocity 1s then 


s'(v/16) = —3 


=-vU 


i) 
a 
ale 
—— 

— 


(the same velocity with which it was initially moving upward). 
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47. 


oye 


a2; 


CHAPTER 12 i 


Apply the Mean Value Theorem to f(x) = /x on [64, 66]: 


66 — 4 1 
a eal =r (Oo) = eG for some x in [64, 66]. 


Since 64 < x < 81, we have 8 < /x < 9, so 
I J66—8 I 
<a —————— 


2-9 eras OB, 
PHopital’s Rule does not lead to the equation 
wm Beate Aig OX 
lim = tim’ —— 


x>1 2x —3 x51 2 


because lim 3x2 + 1 ¥ 0. 


(1) 
: B : . 
lim = lm —— = lm cos’ x = 1. 
x0 tan x x0 SEC“ Xx x0 
i) 
9 3 
» cost x — 1 _ —2sin x cos x 
a a D0 et — 
x0 I= x0 2% 


G), Wimeov—9~@.—1)'/?.. (fey = —G), then x = f) = yo = so 
y=(x-1)!7) 

(111) Tim: ee y= f-'(x), then 

y, y rational 


—y,  y irrational; 


since +y is rational or irrational if and only if y 1s, we have y = x if x 


is rational and y = —x if x is irrational, so y = f (x).) 
(v) 
Xie Dee (0 NG era An 
f(x) = Gig: 5 0 etl PD pee aI 
Ow Xx id. 
wi) fae 


(i) f-! is increasing and f~!(x) is not defined for x < 0. 
(iii) f~! is decreasing and f~!(x) is not defined for x < 0. 
Suppose f is increasing. Let a < b. Then f~'(a) 4 f~!(b), since ees 
one-one. So either a) 2 f"Ovor fa 1@)— fF GO). Butat f @) = 
fe (b), then 

b= (f-'(0) < ff" @) =a, 


a contradiction. ‘The proof is similar for decreasing f, or one can consider 
—f instead. 

Clearly, f + g is increasing, for if f(a) < f(b) and g(a) < g(b), then 
GY -3)@)=f@O 2@i= ($C). + 2b) =F FeO). 

f +g is not necessarily increasing; for example, if f(x) = g(x) = x. (But f-g 


Li. 


74) 
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is increasing if f(x), g(x) > O for all x.) 
f © g is increasing, for if a < b, then g(a) < g(b), so f(g(a)) < f(g(b)). 
(a) If (fog)(x%) = (f° g)(y), so that f(g(x)) = f(g(y)), then g(x) = g(y), 
since f is one-one, so x = y, since g is one-one. 
(f og)7! =g7!0 f—!: for if y = (f o g)~!(x), then x = (f o g)(y) = 
FEO), sos) = fe 2c). soy — 2 (fn): 
ii, fic) = 7 ©), then 
ax-+'b ay +b 
ex acy 


sO 
acxy + bcy +adx + bd =acxy+ady+bcx + bd, 
or 
ad(x — y)=bc(x — y). 

If ad # bc, this implies that x — y = 0. (But if ad = bc, then f(x) = f(y) 
for all x and y in the domain of f.) 
If y = f—!(x), then x = f(y), so 

ay+b 

cy+d 


sO ys Jue 
; 0% = : 
f '@)=y= ee fora -1a)/G: 
cx —a 
(i) ‘Those intervals [a,b] which are contained in (—oo, 0] or [0,2] or 
[2,00), since f is increasing on (—oo, 0] and [2, 00), and decreasing 
on (0; 2)). 
(i) ‘Those intervals [a,b] which are contained in (—0o, 0] or [0, 00), since 
f is increasing on (—oo, 0] and decreasing on [0, 00). 
Since 


SSN 
Yo=aaa—, 
Sy alee) 


we have 
SCS) igo) 
WA Cone 
_ =f"F"@) 
~ Gr Ge 
The formula for the derivative reads: 


dx is ] 


dy $d 
lx 


(f7')"(x) = 


¢ 
(In this formula, it is understood that dx/dy means (f~!)/(y), while dy/dx 
is an “expression involving x,” and in the final answer x must be replaced 
by y, by means of the equation y = f(x).) 
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CHAPTER 13 


vp 


DD 


The computation in Problem 20, when completed, shows that 


dx}/n l 
dx = n(x1/nyn-l ee nx'-(/n) 
l 
& —x(l/n)-1 
nl 


G@=sF VO ie) — Ge) om 
=x(f Qf) Ge Gaus) 
= xf iG) ee eae) cs 
= ae 

(1) 
| | | 
OO) = Se Ss 
h'(h-'(3)) (0) _~—s sin? (sin 1) 
ea ihyaes |. 5 t,} is the partition with ¢; = ib/n, then 


n 


P= 5 Gm, Gt) 


iI 

n b b 
=) G2 pees .— 

n> on 

i 

4 n—| 
= b* ic 

nt 4 

j=0 

b* | (n —1)* y= 1)? =e 
a mS) i =) ar ( ) . 

n 4 p) 4 


and similarly 


Ras Se 
Bet ads ‘ 
J= 


= b* | n4 i n> i n- 
~ “nd. | 4 D aa 


Clearly L(f, P,) and U(f, P,) can be made as close to b*/4 as desired by 
choosing n sufficiently large, so U(f, P,) — L(f, Pn) can be made as small 
as desired, by choosing n large enough. ‘This shows that f 1s integrable. 
Moreover, there is only one number a with L(f, P,) < a < U(f, P,) for 
all n; since fy x3 dx has this property, the proof that fe x3dx = b*/4 will 
be complete once we show that L(f, P,) < b*/4 = Uf, B,) for allt This 


i) 


o: 
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can be done by a straightforward computation, but it actually follows from 
the fact that L(f, P,) and U(f. P,) can be made as close to b+/4 as desired 
by choosing n sufficiently large. In fact, if it were true that b4/4 < he No dy, 
then it would not be possible to make U(f, P,,) as close as desired to bt /4 by 
choosing n large enough, since each U(f, P,) = if x3 dx, and sinilarly we 
cannot have b+/4 > ie de 

We have 


Lp | a | ee Ga | 
no 5 5) 3 30 
. bul nt n> n 
CE. P,) = — + illasibes =— ie Te ey ls 


n> | 5 2 3 


Clearly L(fw?P,,) and U(f, P,) ean! be madesas Glose to b°/5 as desired by 
. Ieee l 
choosing 7 large enough. As in Problem 1, this implies that iE x dix bu 5. 


i) fof =0. 


(For a rigorous proof that the functions in (1), (ii), and (vil) are integrable, 
see Problem 19. ‘The values of the integrals, which are clear from the 
geometric picture, can also be deduced rigorously by using the ideas in 
the proof of Problem 19, together with known integrals.) 


2 2 
sl tel we 16 
I my +2 = xX. a a 
(ii) 
v2 9 9d I/9 
/ [(l —x°) — x7] dx = —. 
=/2/2 3 
(v) 


fies —2u+4)een la 
0 


b d b d 
i (| Flava) dx =! (se f iy)dy) dx (here f(x) is the constant) 


L3. 


d b 
= g(y)dy- f(x)dx 


d 
(here / g(y) dy is the constant). 


(ay Clearly Lf, P) = 0 for every partition P. 
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(b) Apply part (a) to f — g, and use the fact that 
b b b 
fu-o=f f-| g. 
23. (a) Clearly 


m(b—a) < L(f, P) < U(f, P) < M(b—a) 


for all partitions P of [a,b]. Consequently, 


b 
m(b—a) < f(x) dx < M(b—-a). 


a 


Thus 


satisfies m < pu < M. 

(b) Let m and M be the mimimum and maximum values of f on [a,b]. 
Since f is continuous, it takes on the values m and M, and consequently 
the number yj of part (a). 


335 (a) eo 
(b) 5. 
37., simee 
=(J\ Sar Saal 
we have 
b b b 
= vis | ifs fl. 
So) 
b b 
/ PLS Wale 
b 
(Problem 36 implies that | f| makes sense.) 
CHAPTER 14 1G) Gina eer 
x | 
8 1+t-+sin‘t 
b l 
(v) / ro 
a 1+ 744t sin*t 
iy Ee oo = Fe: 
(vu) (F°)'(x) FUF=1(x)) (x) 
2. “ay VOAll eae 
(in) Ae see 
(Vy Alley: 
(vii) All x 40. (F is not differentiable at 0 because F(x) = 0 for x < 0, but 


F(x) l \ 
x 


there are x > O arbitrarily close to 0 with —— 4) 
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a” (a) 
1 1 
IIA a) Se eS” 
Gir) O) f' GO). ~ 1sinGnG =0))) 
l 
ul iL 


1 + sin(sin QO) iv 


8. Foy) f(t) dt, so 
0) 


F(a) SS @)e ih f(t) dt. 
0 


13. We can choose 


HM. 


x (A/n)+1 
f@)= i 
—+1 
n 
Then 
b (1/n)+1 
t/xdx = f(b) = fO)\= i 
0 is a 
n 
CHAPTER 15 i a) 
1 1 1 
1+ arctan?(arctanx) 1l-+arctan?x 1+x2° 
(111) 
| ( > tan x ) 
i a SEC” Xe alclamie = = I 
1 + (tan x arctan x)? 1+ x- 

J, Ai) 0); 

(ain) 0) 

Win: 
7. (a) 


sin 2x = sin(x + x) = sinx cosx +cosxsinx =2sinxcosx. 
9) 5 9) 9) oD, 
€COS2X = COS X — sin x =2 cos- x — t= 1 —2Zsin-x. 
sin, 3x = sin(2x + x) = sin 2x cos x + cos 2x sin x 
: 2 2 2 : 
= 2sin x cos* x + (cos* x — sin* x) sin x 
; 2 5 3 
= 3 sin x Cos’ X — sin” X. 
cos 3x = cos(2x + x) = cos 2x cos x — sin 2x sin x 
2 mee, OUR?) 
= (COs — sin %) COSX = 25m x COSX 
3 LD nee 2 
= cos X —sm’ x cosx — 2sin’ x cosx 
3 2 
= cos x —3sin* x cos x 


3 
= 4.cos’ X = 3. Gos x. 
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o: 


(b) Since cos /4 > 0 and 


(a) 


14 14 
= Cos = oo il, 


IT 
2 4 4 


0 = cos 


we have cosz/4 = J2/2. It follows, since sinz/4 > O and sin? + 
cos’ = 1, that sinz/4 = J2/2, and consequently tanz/4 = 1. Sim- 
ilarly, since cos 7/6 > O and 


14 14 1A LA 
O'= cos — = cos3 += = 4 cos’ | = 3icos =, 


2 6 6 6 


we have cos 7/6 /3/2. It follows, since sinz/6 > 0, that sinz/6 = 


Vl 3)2)- = 


ni= || 


tan(x + y) = peeks) 
; cos(x + y) 
sin x cos y + cos x sin y 
cos x cos y — sin x sin y 
sinxcosy  cosxsin y 
cosx cosy  cosx cos y 
cosxcosy  sinxsiny 
COS X COS y Cos x COs y 
tan x + tan y 


1 —tanxtany 


(b) From part (a) we have 


tan(arctan x) + tan(arctan y) 
tan(arctan x -+- arctan y) = ———@@@————— 
1 — tan(arctan x) tan(arctan y) 


ay 
= 


provided that arctan x, arctan y, and arctan x + arctany #4 ka + 77/2. 
Since —72/2 < arctan x, arctan y < 7/2, this is always the case except 
when arctan x + arctan y = +77/2, which is equivalent to xy = 1. From 
this equation we can conclude that 


ny. 
arctan x + arctan y = arctan | ——— 
l—xy 
provided that arctan x + arctan y lies in (—2/2, 2/2), which 1s true when- 
ever xy < 1. (If x, y > O and xy > 1, so that arctan x + arctan y > 2/2, 
then we must add z to the right side, and if x, y < 0 and xy > 1, so 
that arctan x + arctan y < —z/2, then we must subtract 7.) 
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11. The first formula is derived by subtracting the second of the following two 
equations from the first: 


cos(m — n)x = cos(mx — nx) = cosmx cos(—nx) — sin mx sin(—nx) 
= cosmx cosnx + sinmx sinnx, 
cos(m +n)x = cosmx cosnx — sinmx sinnx. 


The other formulas are derived similarly. 
12. It follows from Problem 11 that if m 4 n, then 


4 l a 
ib sinmx sinnx dx = 5 [cos(m — n)x — cos(m + n)x] dx 


i 1 {({sm(m—n)x  sin(m+n)x 
re) {| m—n 7 m+n 
sin(m—n)rz sin(m+n)z 
- mn - m+n i 
=1(); 
(Note that sin(m — n)(—z) = sin(m — n)z since m — nis an integer.) But if 
m =n, then 


IU ] U 
i sinmx sinnx dx = 5 1 — cos(m +n)x dx 


1 {| sin(m ren sin(m aaa 
== 4|2 — ————__| - | -z —- —————_ 
2 m+n m+n 


= iT. 


The other formulas are proved similarly. 
15. (a) We have 


cos 2x = cos? x — sin’ x 


= 2 sine 
— 2cos* x — 1. 


So 
eD 1 — cos 2x 
sin’ x = ———_—_ 
2 
3 1 + cos 2x 
cos* x = aie cw; 


(b) ‘These formulas follow from part (a), because cos x /2 > 0 and sinx/2 > 0 
(since O=< x =< 77/2). 


(c) 


2 Ne 3 1 l 
| sin? xdx = | is ee) z in 2b — sin 2a). 


B oil 2 l | 
[ cot xax= | OS dx = 5b — a) + Z(sin 2 — sin 2a). 
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CHAPTER 18 


19. 


20: 
ZA, 


(a) arctan 1 — arctan0 = 7/4. 


(b) lm arctan x — arctan 0 = 77/2. 


l | 
lim xsm— = lm —sinx = 1. 
x00 BX; x—0+ X 
(a) 
(smn) Ge)ys= a cos (—) ee cos’ (x) 
é 180 §=\180 180 , 
( ae) ‘(x)= TU ay (—) = els ° a 
Gos) (ee) = 180° sin i180) ~ 180 Sim 16%): 
b) I sin’ x i; sin(ztx /180) i mz = sin(zx/180) 
D) lim = lim ———— _ = lim — . ——__ 
Ohne x 0 XG x0 180 mx /180 
i vee i; sin x U 
im xsin° — = lim — 
x— 00 5g x 0+ x 180 


(11) (sin x)sin(sin x) [(log(sin x)) - cos(sin x) - cos x 


IT 


© 180" 


+ (cosx/sinx)-sin(sinx)] . 


a - (sin x)" SENG ITIEG l Shee sax 1] 2 o COS x 
(v) (sinx) (sin x ) - log(sin x)}cos x - log(sin x) + sinx— 


at (sin x ysn x 


. . x log(sin e*) : XG (cos 
(vu) | arcsin ( (log (aresin ( )) — 
sin x sin x sine” 


sin x 
COs Xx 
sin x 


e* )e* 


sin X — X COSX 


+ log(sin e”) - 


arcsin ( 
/ log x I ] l 
(ix) (log x)'°8* - | log(log x) - 3 + log x - gee ial 


sin x ) 


(xi) cos(xsine™ x ’) : x Sin cos(a—" 2) E ysinx 2 log x 


Cos x 
cosx - log x + —— 


I x, 2 wD) 
- l-—({- - sin* x 
sin x sin x 


% sin xsinx) 
| 
r x 
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8. (a) 


2 A) 
cosh x — sinh“ x = 


(c) 


inh x cosh y + cosh x sinl a (a ag i ee 
sn coin SS | —S— a eee 
sinh x cosh y + Cos Ss y 5 5 ; : 


4 4 4 4 
exty = e  Xt+y) 
= ane Tg ace = sinh(x + y). 
(e) Since 
; | Ga + Cm: 
sinh — 
2 
we have 
, ex —e% 
sinh (x) = ———— =coshx. 
2 
(g) Since 
sinh x 
fanhie— ; 
cosh x 


we have 


P (cosh x)* — (sinh x)? 
tanh’ (x) = ————__,——_ 
cosh* x 


= - by part (a). 
cosh* x 


OF (ay Ify= cosh! x, then y > 0 and 


x. =) coshyy = v le: sinh? y by Problem 7(a). 


So 
sinh(cosh~! x) = sinh y=vx*-1 since sinh y > 0 for y > 0. 
(c) 
eee) T5187 I 
(sinh) @&) = 7 Se ee 
sinh (sinh (x)) 
| 


cosh(sinh — (x)) 


l 
= ———— by part (b). 


J1+x? 
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l 


(tanh ')/(x) == a an ae 
tanh (tanh “(x)) 
= cosh?(tanh—! Ge): 
Now, 
tanh? y + ——,— =1 by Problem 8(b), 
cosh” y 
Ne) 
tanh” (tanh “(¢)) 2 = 
cosh” (tanh — ; (x)) 
or 
cosh?(tanh~! ie) — : 
1 —x2 
10. (a) If y=sinh’' x, then 
e — Ca 
x = sinhy 5 
sO 
e’ —e *’=2x, 
e”” — 2xe” -1=0, 
m 2x + V4x24+4 
e = 
2 
sO 
e=x+vl1l+x2 sincee’ >0 
or 
i= sinh! x = log(x+v1 +x). 
Similarly, 


cosh! x = log(x +Vx2—1), 


tanh! x = 5 log(1 x)= 5 log(1 =) 
(b) 


ae 
/ dx =sinh-'b—sinh~'a_ by Problem 9(c) 
a V¥1+x? 


= log(b + V1 +62) —loga+V1+a7’). 
he rae ee aoe a,b>1 
x= 
a Wx2—1 —log(—b + Vb? — 1) + log(—a + Va? — 1) a,b < —] 


oR 1 
7 ace = 5 log +b) — log(1 — b) — log(1 +a) + log(1 — a)]. 
q |1-x 


20), 


Ae 


yap, 
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(a) lim a* = lim e*'8¢, Since loga < 0, we have lim xloga = —o0, so 
Smear oS) Air AOS) : P, toad, ©) ; 
lum e* 84 = 0. 
GO) 
(lo x)" yn” 
(c) lim S = ino So 
x00 x yoo ey 


(e) lim x* = him e*!°8*, Now, lim x logx = 0 by part (d), so lim x* = I. 
x0 x0 Oe x>0t 


(a) lim log(1 + y)/y =log’(1) = 1. 


(b) lim x log(1 + 1/x) = im log(1 + y)/y = 1. 
x00 y= 0+ 


e =exp(]) = exp(lim xlog(1 + 1/x)) 
(slim exp@eloc@ +- l/x)) 
x00 
weal | Ae)”. 
pia 12.9) 


(The starred equality depends on the continuity of exp at 1, and can 
be justified as follows. For every ¢ > 0 there is some 6 > O such that 
le — expy| < e for |y — 1| < 6. Moreover, there is some N such that 
|x log(1 + 1/x) — 1| < 6 for x > N. So |e — exp(x log(1 + 1/x))| < e for 
> N., 
(d) 
e° ='(lim (EP iyx)5) = lm GP lj) 
Sim oS xX CO 
= im + 1/x)* 


= lim (1 +a/y)’. 
yoo 


After one year the number of dollars yielded by an initial investment of one 
dollar will be 

lim (1 +a/100x)* = Pie 

xX CO 


tajClearly f(x), SVs tion = Oe i tee 0 theney(x) = log(=x)yso 
f'@) = (-1)-1/(-*) = 1/x. 

(b) We can write log |f| as go f where g(x) = log |x| 1s the function of part 
(a). So dog If)’ =o f)- f= l/f-f 

(ce) Lcing (x) = Faye] then 

e* fi) — f@)ce™ _ 


ee 


e2cx 
so there is some number & such that g(x) =k for all x. 

(a) According to Problem 21, there is some & such that A(t) = ke“. ‘Then 
k=ke'= Ao. So A(t) = Ape”. 

(b). If Att +1) = A(@t)/2, then 


Gil 
Agel ~—_ Age 


~ 
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Sot elk Seo" Dior era 55 so t = —(log 2)/c. It is easy to check that 


this tT does work. 


23. Newton’s law states that, for a certain (positive) number c, 
i @) Sei): 
which can be written 
(T — M)' =c(T —M). 
So by Problem 21 there is some number k such that 
T(t) -M=ke", 


and k = ke®' = T(0) -M = Tp — M. So T(t) =M + (Tp — M)e™. 


CHAPTER 19 1. @i (7x3 + fc) [fe = x10 4 U3. 
_ve=l-=ve4l 

v¥x—-1l+vyx+1 7 =2 

(lit) Gee etnen, )/ Cr — es cme ee, 

Gv) ab = G@/b)*= eee), 

(v) tan? x = sec? x — 1. 


(i l 1 /a’ 
vl) = = ———.. 
1 sa 
a) 
2s l/a 
vi) ———S._— = —__——_————.. 
ei (x(a) 
ee l 1 — sinx 1 —sinx 5 
(vin) ————— = ————— = ——— = sec’ x —secx tanx. 
]+sinx sine x cos? x 
Sx2 4 6 
(ix) AA 
x+1 x+] 
1 | 


@) = 
V2x—x2 V1l-(x-1)2 


G) —cose*. (Let vu =e’.) 

(iii) (log x)*/2. (Let u = log x.) 

(i) ie". (et =e) 

(vii) 2e¥*. (Let u = JX.) 

(ix) —(log(cos x))?/2. (Let u = log(cos x).) 


3. @ ile dx = x*e* — (| 2xe* dx = x7e* —2 ve" - he ar| 


iar. ; . 
= x*e* —2xe* + 2e”. 
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(ii) We have 


a e“sinbx  b ; 
/ Cie SIMMS Oa (C7 COSI ECG 
a 


a 
e-sinlpG  _D |e? "GosiDx. 1D a : 
SS ee ican simipraiaaa |, 
a a a a 


sO 


e cos bx. 


aes a ~ b 
Ce (SiO) 0.6 (0155 Se S00 (082 Se 
Ge (ies lok 


(v) Using the result {dog x) dx = x (log x)? 2x (logx)+2x from the text, 
we have 


[coe x) x [x (log x)? — 2x (log x) + 2x] log x 


I 2 
= / =—|x(og x)- — 2x(log x) + 2x] dx 
% 
= x(log x)? — 2x(logx)* + 2x log x 
— [oe De) a= 2 polos aol = 25 

= x(logx)? — 2x (log x)* + 2x log x 

= |x(logx)- — 2ndoee) a0) 2 alos 4) 
= x(logx)? — 3x(logx)? + 6x log x — 6x. 


(vil) 
k 
[xe ae [ove x)(secx) dx = tam x sex — [can x)(sec x tan x) dx 
?) 
= tanxsecx — | secx(sec~ x — 1) dx 
Ae . Bias oe eee 
= tan x sec x — [ sc xdx+ / SEGX GX. 
sO 
[xc xdx = 4{tanx secx + log(sec x + tan x)]. 


(ix) 


2x3/2 Z 9 l 
/ J/x log x dx = : log x — ate ax 
3 3 x 


2x3/2 2 9 
= 3 log x — 5 fe? ax 


23/2 cee 
= lorax =a! 
3) ; 9 


Gj) Let x =smu, dx =cosudu. The integral becomes 


cosudu : 
SS = ida =u = arcsinx, 
Vv 1 — sin“ u 
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(i) Let x = secu, dx = secutanudu. The integral becomes 


secu du = log(sec u + tan uv) 


/ secu tanudu 


Vsec2u — 1 A 
= log(x + ay 


(v) Let x =smu, dx =cosudu. The integral becomes 


| cosudu ¥ fon aeOue) 
—————— = { cscudu = — log(cscu + cotu 
sin uy 1 — sin“ u 
l Vv1—x2 
= oe ke Tile MS 


(vu) Let x = sinu, dx = cosudu. The integral becomes 


13 8} 2 me 2 2 
[in wos) cosudu = f sin ucos- udu = fina — cos u) cos" udu 


cos? Uu cos” u 


za eS 


e 2) 
= [iin u)(cos~ u — cos* u)du = — 


dd —— x2)3/2 @ eg x2)9/2 
C2 pe 


(ix) Let x = tanu, dx = sec? udu. The integral becomes 


[ usec?udu = | seciudu 
= 5[tan usecu + log(secu +tanu)| by Problem 3(vii) 
= 5 [xv 1+x2+log(x+V14x?)]. 


5. (i) Letu=Vx4+1,x =u? —1, dx =2udu. The integral becomes 


[xs =| Dei: —2 a 
l+u l+u 


= 2u —2log(+u) =2V/x+1—-—2log1+Vx+4+1). 


(iii) Let wu =x!/°, x = u°, dx = 6u> du. The integral becomes 


6 Sd l 2 
i u a =| G a a | —) du = 2u> — 3u? + 6u — 6log(u + 1) 
icone u+ 1 


= 2/x —3 x + 6S/x — 6log(£/x + 1). 
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(v) Let w = tanx, x =arctanu, dx = du/(1+u7). The integral becomes 
i du ( | u—2 ) 
$$$ — ——, } du 
(d+u-)\(2+u) 5 2+tu 1+4u- 


sfssc- of eet fl 
< 2+u 1+u2 ¢ 5) 1+ u2 


: J 
| tog(2 sh 1) = = 9 los tae 5 arctan u 


m5 


1 l D 
= 5 log(2 + tan x) — T0 log(1 + tan? x) + rad 


(vii) het ur = 2% « = @ogwy/Cog2), dx = duf@log2), Whe iteeral 


becomes 


i pee | i 
— du = —— 1 + ——— ] d 
ola i Sl + | : 
i l 2 
= 1+ — ———_ ]d 
Si ee a) 


_ ogo ee —2logtu + 1)] 


] 
= [2* + x log 2 — 2log(2* + 1)]. 
log 2 ; 


(ix) Let u = /x, x =u?, dx = 2u. The integral becomes 


(qe 2udu 


l—u 


Now let u = sin y, du = cosydy. The integral becomes 


mH 


: 2 5 
2 cos y sin y cos y (1 — sin* y) sin y 
dy =2 | ————_ 


1—siny 1—siny 


= 2 fa + sin y)sin ydy 


=2f sinyay+ [1 — cos2ydy 


sin 2y . 
= —2cosy + y — —— = -2cosy+ y—sinycosy 


2 
= —2V/1 —u2 + arcsinu — uv 1 — u2 
= —2,/1 — x + arcsin Ae Vx 1 —x. 


The substitution vu = /1 —x, x = 1—u?, dx = —2u du leads to 


| —2u~ du 
(A ear 


654 Answers to Selected Problems 


and the substitution u = sin y then leads to 


= —2sin y — y—sinycosy 


= —2y — arcsinu —uv 1 — u2 
= —2/1-—x —-arcsin/l—x-vVl1- xvx. 


These answers agree, since 


ets) 
/ —2sin° y cos ydy 


] —cosy 


3 IT F 
arcsin /x = ee arcsin / 1 — x 


(check this by comparing their derivatives and their values for x = 0). 
6. In these problems / will denote the original integral. 


(i) 
fe ee ax f ery 
-{§= ; Gari 
3 
= 2log(x — 1) —- ——. 
bay ) x+] 
(iit) 
I | ax f Fide g 
— | ee. 3 
(x — 1)? G@ #133 
Z | 2 
CE) (Ge sei by: 
(v) 
a art | elie 
= Dyn eee eae ea haa 
= 5 log(x* + 1)+ 4 arctan x. 
(vil 


) 
1 Dx 
= 9 ao ies SAT 
fa pf 


| 2x +1 | 
={[aet {se e-fa 
x+1 x*+x+1 x-+x+1 
Now 


l l 
[=i = / ear 
xe +x + I (x+5)*+ 3 


= : : re arctan (3, (x ai +)) 
5} 


Answers to Selected Problems 655 


sO 


V3 : 
3 arctan (= (« = +)). 


apm 2x +1 | | 
(x2 +x ryan (x2 +x +1) 


2x + | 2.28 ] 
(x2 +x +41)? 2 (3 as. ype 


Now the substitution 


5 2 
i—loetes Ly losGre st v4- l= 


dx. 


u= (x43), dx = 8 du 
changes the second integral to 


1G 14/3 du 
9. 2 (uz + 1)2- 


Using the reduction formula, this can be written 


8/3 u sh >| du 
S| XZ DP pe 


sO 


i 1 V3 (a+ 5) 4/3 (e ( a ay), 
= — — — — —  __ _ ___ arctan | & (x 
yee ee AGE eee NB 


14. The equation f e* sin x dx = e* sin x —e* cos x — [ e* sinx dx means that any 
function F with F’(x) = e* sinx can be written F(x) = e* sinx — e* cosx — 
G(x) where G is another function with G’(x) = e* sinx. Ofcourse, G = F+c 
for some number c, but it is not necessarily true that F = G. 


16. (a) 


, 2 : x 
i arcsinx dx = i [ -aresin xa — X’aresin x — ii 3 
J1—x2 


: 9 
=xarcsnx+vl1—x-. 
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17x “(a) 
ff sit xay = — S222 43 finde 
4 4 
be _ sin? x cosx +3\- sin x COs x +5 f tax] 
4 4 2 Z 
he-2 sin? x cos x rue 3 sin x cos x re = 
4 8 ae 


w+, /-S". 
a 4 2 - 


Simon wl E sin 4x 


2 2 
[sisteax= [ (==) vm f (G- S452) dx 
x 
4 
x 
4 


4 ri oe 8 
3% ‘sin2x sin4x 


g. grat =a 


(b) It follows that these two answers are the same, since they have the same 
value for x = 0. 


Dales « s(a) 
sin’ doe [ovin x)(sin"! x) dx 
= —cosx sin” !}x+(n—1) il cos x(sin” x) cos x dx 
= —cosx sin” !}x+(n—1) Join"? s — sin” x) dx, 


sO 


| — | 
[ sn" x dx = —-—cosx sin” !x + a [sot xae. 
n n 
(b) 


[cos'xas = [(cosxy(cos™ ©) dx 
= sinx cos”! x + (n — 1) ‘| sin x(cos” 7 x) sin x dx 
= sinx cos’! x + (n — 1) [cos X% — COs" x)\ax, 


so 


1 eae n—1 
[ 0s x dx = —sinx cos”! x + cos”? x dx. 
n n 
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(c) 
dx dx x* dx 
(eeseeried re ante ra 
dx i 
oo cosy ia ae cr 
fis Be 
7 / (x2 + 1ynt Es SOC Ss ee 


dx 
21 =n)(x2 # 1)"7! 


sO 
l 2% 2n — 3 ] / 

ee ee ee ee ogy ea aay) | anes Ep, | 

(e+ 1)" 2n—1) 241") 2H -—D J (x2 +127! 

We can also use the substitution x = tanu, dx = sec? udu, which 


changes the integral to 


: 
sec udu 5 
= eee | GOS” 2 udu 
SeGa iy 


I 2n—3 Zi 2n 
— COS” MS COS” 


2n —2 2n —2 
| l x 2n —3 as 


a es 53 / we 
o = ( x24 a iss 3 pa on (x? a Tee 


] x ol o dx 
~ Qn —1) (x2 + 1)! | 2n—2 ie 


CHAPTER 20 1. (@) P3o(xv) =et+ex tex? + (5e/3!)x?. 
“ x—2/2)? (x—2/2)4 (—1)"( — 2/2)?" 
(it) Pann/2() = | Ti. ona 
ee 1)? Ae 


(v) Ce 


ni! 
(vil) Pao(x) =x + x? 
(ix) Pons1o(x) = 1 — x? +.x4# — +--+ (- 1) "x". 

2. If f is a polynomial function of degree n, then ft? = 0. It follows from 
Tavicrs) Uheorem iat ky, (x) = 0, so f (4) = Fra): 


Op PE = res). 
(iii) 243+ 405(x — 3) + 270(x — 3)? + 90% — 3)? + 15@ — 3)* + — 39°. 
9 


(Saya! 4 
od) 2 GF DI (since Qua! < 107'" for 2n +2 > 19, orn > 9), 


8 ? 
noe coal): : I 257) 
ee 2 "9 4 8 
(iii) ) (i+ D! (sinc nn PDI <= IQ" =etor 2h 4 2 = 8, 


Ty 2 (i + 
orn > 8), 
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CHAPTER 22 


CHAPTER 23 


13 2! 32 ; gut 
(v) 2 = smce rear] < 107° forn+1> 14, orn = 13 


(1) C= a; + b;. 
Gi) Ga a + 1a. 


(v) C9 =| Valb) di ae; Whey a onde: 
0 


GQ) l—nf/(n+1)=1/(24+1) <e¢ forn+1> I/e. 


(ii) lim ¥n2+1-—JVa4+1= lim (Vn moa @ n?)+ lim (Vn- ay ele ) 
NO Ha>& nO 
=0+0=0. (Each of these two limits can be proved m the same way 


that lim (/n + 1 — /n) = 0 was proved in the text.) 
Nn OW 


(v) Clearly lim (loga)/n =0. So lim Va = lim e°8/" = @° (by Theo- 
n> co N—> OO N>0O ‘ 


yelp) = le 


(vit) Vn2 < Yn24n < V2n2, s0 (ny? < Vn24n < V2(24M), and 
lim (¢/n)? = lim 196 “<n)? = | by parts (v) and (vi). 
i Co Ti OO 


(ix) Clearly e() < log,n, and lim (log, n)/n = 0. 
a Nn 0O 7 


n 5) 
(a) IPO" eetnen ad = 2¢ = 4 soa =< /2q <2. 


(b) Part (a) shows that 


V2 < $29 <V 222 <-- © 2. 


so the sequence converges by Theorem 2. 

(c) If this sequence is denoted by {a,}, then the sequence {V 2an } is the 
same as4{@,anje oo tlie hint shows thatyi= Vv 22 orsf=2) 

If x is rational, then n!zx is a multiple of wz for sufficiently large n, so 

ibe . . dL ie 
(cosn!ax)** = | for all such n, so lim (lim (cosn!ax)**) = 1. If x is 
n=O k—>oo 
irrational, then n! zx is not a multiple of z for any n, so | cosn!ax| < 1, so 
. BE 
lim (cosn!ax)-* = 0, so f(x) = 0. 
kK>u 


I 
(1) i e* dx =e -— |. (Use partitions of [0,1] into 7 equal parts.) 
0 


| 
lil aa log 2. 
weet 


re i | l 
Vv ——__ a =. 
9 (l+x) 2 


a * a ; 4 4 
(1) (Absolutely) convergent, since |(sin n@)/n-| < I/n-. 
Gi) Divergent, smee the first 27 terms have sum 4 +---+4+1/n, (Letbniz’s 


‘Theorem does not apply since the terms are not decreasing in absolute 
value.) 


Answers to Selected Problems 659 
(v) Divergent, since 
I | 
3 a PNB 
Vnieo—le 9 ees 
(vu) Convergent, since 
: (n+1)7/m+ 1! , n+1 2 ] 
lim ——.————_ = lim = (0: 
n—> oo n-/n! noo n n+1 
(ix) Divergent, since 1/(logn) > 1/n. 
| 
(x1) Convergent, since 1/(logn)" < i for n= 9: 
(xin) Divergent, since 
9 
n- ] 
———————— > — 
ne+1  2n 
for large enough n. 
(xv) Divergent, since 
Nees 
ii dx = log(log N) — log(log 2) > co as N > ow. 
2 xlogx 
(Notice that f(x) = 1/(x log x) is decreasing on [2, 00), since 
—({1+logx 
i eo — es bea Sad 98%] <0 for. > le 
Glogs) 
(xvii) Convergent, since 1/n?(logn) < 1/n? for n > 2. 
(xix) Convergent, since 
ee (eee bye , 26-207; 
ko SY = lim ————- 
noo 2"n!/n" n>oo (n+ 1)r*1 
2 
=" him =, 
noo l (Z 
1+7) 
n 
by Problem 18-17. 
(a) For each N we clearly have 
N (or) 
Oei ale =O e100" =m 
n=1 n=1 
oe) 
Se) ea 10°" converges by the boundedness criterion, and les between 
n=1 
0 and 1. (Actually, this number is denoted by 0.a)a2a3a4... only when 


the sequence {a,} is not eventually 0.) 
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CHAPTER 24 


20. 


The area of the shaded region is 5. The integral is 


(Ul alec la = al Lig = aa) Soa eieedlola— aolbrer 


i 


l il i 1 It fil 1 i 1 
Get ao + oe POH aG ea eet ose tO) 
(+;+e+qt:)-g0+g+e+aqt) 

1 1 | 
l+-4+—5+4+—+::: 


Dal — Cle ool — Fv 
= 


0; «= 0 
Fes) = fim, fa = | i Oe 


{fn} does not converge uniformly to f. 
ix) = im fi) = On(sinee im x —ooor 2 > 1), Whe sequence 
{fn} does not converge uniformly to f; in fact, for any n we have f,(x) 
large for sufficiently large x. 
fe) = lim fn(x) = 0, and {f,} converges uniformly to f, since 
| fn(x)| 2s for all x. 

2 


1 x 3 


a 
ee erg 
yey al 
k=0 k 
-} 
55 p( ) 
k 2kH 
rae 2k + 1 
ee 
If 
ae mga ee 
Aine oO) ae 
then 
2 3 
Oe = 


= log(1 +x) sia lp 


so for |x| < 1 we have f(x) = (1+ x)logd +x) -— (+x) +c for 
some number c. ‘Since f(0) = 0, we have c = 1, so f(x) = (1+ x)- 
log(l +x) —x for |x| < 1. : 


CHAPTER 25 
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Since - ee 
—])"'x2" 
Misc = 2 ners 
we have a ie 
2 —])"x2" 
TY dX = : 1)! 


(notice that the right side is | for x = Q). So 
(a 
FOO) =) WT 
0, k odd. 


= 


i) |3+4i%| =5; 6 = arctan . 

Gil) [1 +7) =((1 +i) = (V2); since 2/4 = arctan I/1 is an argument 
for | +7, an argument for (1 + i)? is 5/4. 

ee (ee) eas — 8 


a 
= 2 
_-itV5i 


2 
—(-14V50i (1 -V5)i 
= me 
(ii) x? + 2ix — 1 = (x +1), so the only solution is x = —i. 


(v) x? —x?—x —2= ( —2)(x7 +x +4 1). The sohitions are 


oe oe 1 V3. 
- = i. 


Gi) All z=7y with y real. 

Gi) All z on the perpendicular bisector of the line segment between a and b. 

(v) Fors =x +iy, we need Vx? + y? < 1 —x. This requires that 1 — x > 
Q, and then our inequality 1s equivalent to Res yee ee or 
x < (1 — y’)/2 (and conversely this inequality implies that x < 5, sO 
that | ~x > 0 holds). The set of points x +iy with x = (1 — y7)/2 is the 
parabola pointing along the second axis, with the point 4 + 0i closest 
to the origin, and which passes through the points 0 +7 and 0 — i; the 
desired set of complex numbers is the set of points inside this parabola. 

jx +iy|? = x*+y? =x? +4 (-y)? = [x —Jy/?. 

(2+2)/2=[(«+iy) + —iy)]/2 =x. 

(z —z)/2=((@ + iy) —(@ —iy)]/2i = y. 

lz + wl? + [z — wl? = @ + w)(Z + H) + @ — w)E — W) = 222 + QwH = 

2(\z/? + |w|?). Geometrically, this says that the sum of the squares of the 

diagonals of a parallelogram equal the sum of the squares of the sides. 
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CHAPTER 27 


(ii) 


(111) 


(111) 


Converges absolutely, since |(1 +7)"/n!| = (/2)"/n!, and Yiw2)"/n! 


n=l 
converges. 


Converges, but not absolutely, since the real terms form the series 


i} f+ $4) 


Diverges, since the real terms form the series 


log 3 log4 log5— log7 log8  log9 
: 2 2, 
oe A 5 A AG 9 
The limit 
; el" /(n + 1)? 7 ( n if nee 
ene \z|\" /n2 7 neste n+ 1 me 


ise—litor|z| < 1, bur Istor|zi— 


The limit 
Iz es 1 


= |z| 


n—>0Oo |z|” 


is <li tor|z|< 1 but = ior |z|> 1. 
The limit 


Qnrt+l |z[erD: 


= inne? (n+1)!—n! 
n>co = 2M (z\n! n> 00 Z| 


is Olongi—= ke but'co for |z| =r 


The limits 


lim 2n z|2" = Iz| and lim 2n+1 ieee rae \z| 
c 


noo 3n os V3 n—>0oo Qnt+1 V2 


are ilo lle J/2, so the series converges absolutely for |z| < J/2. 


But the series does not converge absolutely for |z| > V2, so the radius 
of convergence 1s V2. 


Since 
a. nf lai Seal Cie, Iz| 
lim = lim —*/n = — by Problem 22-1), 
n—> Ooo n n—> oo 2 9p) 


the radius of convergence 1s 2. 
The limit 


0 n . Sit 
lim /2"zn! = 2 lim z@—) 
noo n—-> Oo 


is 0 for |z| < 1, but oo for |z| > 1, so the radius of convergence 1s 1. 
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for tana oy 
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Associative law 
for addition, 9 
of vectors, 76 
for multiplication, 9 
Average velocity, 152 


existence of, 9 
for vectors, 76 
Additive inverses 


Axis 

existence of, 9 horizontal, 57 

Algebra, Fundamental Theorem of, imaginary, 534 
377, 538, 548, 567 real. 533 
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greatest lower, 134 

least upper, 133, 584 

lower, 134 

upper, 133 
Boundedness criterion, 474 
Bounded above, 122, 133, 457, 584 
Bounded below, 134, 457 
Bourbaki, Nicholas, 148 


Cantor, Georg, 448 
Cardioid, 89, 250 
Cartesian coordinates, 84 
Cauchy 
Condensation Theorem, 496 
criterion, 473 
form of the remainder, 437 
Mean Value Theorem, 204 
product, 493, 513 
sequence, 459, 571 
equivalence of, 599 
Cauchy-Hadamard formula, 569 
Cauchy-Schwarz inequality, 281] 
Cavalieri, Bonaventura, 275 
Cesaro summable, 493 
Chain Rule, 174 {f 
proof of, 178 
Change, rate of, 152 
Characteristic (of a field), 586 
Circle, 65 
“f cirele "44 
unit, 66 
Circle of convergence, 560 
Classical notation 
for derivatives, 154-156, 162, 167; 
187924 =242 
for mitegrals, 265 
Clero, 186 
Closed interval, 57 
Closed rectangle, 547 


Closure under addition, 9 
Closure under multiplication, 9 
Commutative law 
for addition, 9 
of vectors, 76 
for multiplication, 9 
Comparison test, 474 
limit, 475 
Comparison ‘Theorem, Sturm, 323 
Complete induction, 23 
Complete ordered field, 584, 603 
Completing the square, 17, 379 
Complex analysis, 565 
Complex function 
continuous, 545, 546 
diflerentiable, 550 
graph of, 542 
limit of, 542 
nondifferentiable, 551 
Taylor series for, 563 
Complex nth root, 536 
Complex numbers, 526, 531 
absolute value of, 534 
addition of, 531 
geometric interpretation of, 535 
geometric interpretation of, 533-534 
imaginary part of, 53] 
infinite sequence of, 555 
infinite series of, 555-557 
logarithm of, 570 
modulus of, 534 
multiplication of, 531 
geometric interpretation 
of, 535-536 
real part of, 531 
Complex plane, 533 
Complex power series, 557 
circle of convergence of, 560 
radius of convergence of, 559 
Complex-valued functions, 541 
Composition of functions, +4 
Concave function, 220 
Conditionally convergent series, 481 
Cone, 80 
generating line of, 80 
surface area of, 404 
Conic sections, 80; see also Ellipse, 
Hyperbola, Parabola 
Conjngate, 534, 539 


Conjugate function, 541 
Constant function, 43 
Construction of the real numbers, 
588 ff. 
Continued fraction, 462 
Contmuous, uniformly, 144 
Continuous at a, 115, 545 
Continuous function, 115, 118, 546 
nowhere diflerentiable, 159, 509 
Contmuous on (a,b), 118 
Continuous on [a,b], 118 
Contraction, 466 
Contraction lemma, 466 
Converge 
poimtwise, 502 
uniformly, 502, 506 
Convergent sequence, 453, 555 
Convergent series, 472, 556 
absolutely, 480, 556 
conditionally, 481 
Convex function, 219 
strictly, 228 
weakly, 228 
Convex subset of the plane, 229, 553 
Cooling, Newton’s law of, 356 
Coordinate 
first, 57 
second, 57 
Coordinate system, 57 
cartesian, 84 
origin of, 57 
Coordinates 
polar, 84 
“Corner”, 60 
Cos, 303-304, 306, 321-322, 563 
addition formula for, 314 
derivative of, 172, 307 
inverse of, see Arecos 
‘Taylor polynomials for, 413 
remainder term for, 424 
Cosh, 353 
Cosine, hyperbolic, 353 
Cotm310 
derivative of, 310 
Countable, 449 
Counting numbers, 21 
Critical point, 190 
Critical value, 190 
Cst, 310 
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derivative of, 310 
Cubic equation, general solution, 
528-529 
Curve 
parameterized, tangent line of, 246 
parametric representation of, 244 
reparameterization of, 247 


Cycloid, 250 


Darboux’s Theorem, 214 
De Moivre’s Theorem, 536 
Decimal expansion, 73, 492, 599 
Decreasing function, 195 
Decreasing sequence, 457 
Dedekind, Richard, 38 
Defined implicitly, 241 
Definite integral, 365 
DEFINITION, 47 
Definition, recursive, 23 
Degree (of a polynomial), 42 
Degree measurement, 304-305 
Delicate ratio test, 493 
Delicate root test, 493 
Dense, 140 
Derivative, 149 ff, 151 
classical notation for, 154-156, 162, 
167, 187, 241-242 
higher-order, 16] 
“infinite”, 158 
left-hand, 156 
Leibnizian notation for, see Derivative, 
classical notation for 
logarithmic, 351 
“negative infinity”, 158 
Cl fa Foil 
of f at aed 
of vector-valued function, 246 
right-hand, 156 
Schwarzian, 184 
second, 161 
Schwarz, 439 
Derivative of quotient, mcantation for, 
al 
Descartes, René, 84 
Determimant, 79 
of vector-valued functions, 248 
Diagonal, 233 
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Difference operator, 573 
Diflerentiable, 151, 550 
Differential equation, 292, 300, 321, 
322-323, 356, 361, 438-440 
initial conditions for, 440 
Differentiation, 168 ff. 
implicit, 24] 
logarithmic, 35] 
Differentiation operator, 573 
Dini’s Theorem, 524 
Directed angle, 303 
Dirichlet’s test, 495 
Disc method, 402 
Discontinuities of a nondecreasing 
function, 450 
Discontinuity, removable, 121 
Disraeli, Benjamin, 2 
Distance, 58, 534 
shortest between two points, 278 
Distributive law, 9 
Diverge, 453, 556 
Division, 6 
Division by zero, 6 
Domain, 40, 41, 47, 601 
Dot product 
of vectors, 78 
of vector-valued functions, 246 
Double intersection, 165 
Double root, 185 
Durege, 38 


e, 343 
irrationality of, 429 
relation with 2, 448, 564 
transcendentality of, 444 
value of, 344, 426 
Eccentricity of ellipse, 87 
Elementary function, 363 
Ellipse, 66, 82 
axes of, 87 
eccentricity of, 87 


equation in polar coordinates, 86-87 


focus poit of, 66, 86 

major axis of, 87 

minor axis of, 87 
Ellypsoid of revolution, 405 
empty collection, 23 


Entire function, 567 
Epsilon, 18 
Equal up to order n, 418 
Equality, order of, 418 
Equations, differential, see Differential 
equations 
Equivalent Cauchy sequences, 599 
Etymology lesson, 82 
Euler, Leonhard, 575 
Euler’s number, 463 
Euler-Maclaurin Summation Formula, 
576 
Even function, 51, 199 
Even number, 25 
Eventually mside, 555 
Exhaustion, method of, 141 
Exp, 343 ff, 563 
classical approach to, 357 
elementary definition of, 468 
Taylor polynomials for, 413 
remainder term for, 426 
Expansion, decimal, 73, 492, 599 


Extension of a function, 115-116 


Factorial, 23 
Factorials, table of, 432 
Factorization into primes, 31 
Fibonacci, 32 
Fibonacci Association, 32 
Fibonacet Quarterly, The, 32 
Fibonaect sequences 32,921 572 
Field, 581 
characteristic of, 586 
complete ordered, 584, 603 
ordered, 583 


First coordinate, 57 


First Fundamental Theorem of Calculus, 


285 

Fixed pomt of a function, 465 
Focus point, 66, 86 
Force, as vector, 76 
Four leaf clover, 88 
Fourier series, 318, 320, 323 
Fraction, continued, 462 
Function, 39, 47 

absolute value, 541 


Function (continued) 
argument, 542 
discontinuities of, 546 
complex valued, 541 
composition of, 44 
concave, 220 
conjugate, 541 
constant, 43 
continuous, 115 ff. 
convex, 219 
critical point of, 190 
critical value of, 190 
decreasing, 195 
derivative of, 149 ff. 
differentiable, 151, 550 
elementary, 363 
entire, 567 
even, 21, 199 
exponential, 343-344 
extension of, 115-116 
fixed point of, 465 
from A to B, 601 


from real numbers to the plane, 244 


graphs of, 57-65, 198, 542 
hyperbolic, 353 

identity, 43 

imaginary part, 541 
implicitly defined, 241 
increasing, 195 

integrable, 258 

integral of, 258 

inverse, 231 ff 

linear, 58 

local maximum point of, 189 
local mmimum point of, 189 
local strict maximum point of, 218 
logarithm, 341, 346 
maximum point of, 188 
maximum value of, 188 
minimum value of, 188 

most general definition of, 601 
negative part of, 51 
nondecreasing, 243 
nonincreasing, 243 
nonnegative, 51 

notation for, 40, 45 

odd, 51, 199 

one-one, 230 


periodic, 71, 164, 298 
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polynomial, 42 

positive part of, 51 

power, 60 

product of, 43 

quotient of, 43 

rational, 42 

real part, 541 

real-valued, 54] 

“reasonable”, 68, 118, 149, 180 

regulated, 524 

square root, 546-547 

step, 278 

strict Maximum point of, 218 

sum of, 43 

trigonometric, 303 ff. 

value at x, 40 

vector-valued, 244 

Fundamental Theorem of Algebra, 377, 
538, 549, 567 
Fundamental Theorem of Calculus 
First, 285 
Second, 289 


Gabriel, 408 
Galileo Galilei, 148, 164 
Gamma function, 394, 444 
Generating line, of a cone, 80 
Geometric mean, 33 
Geometric series, 473 
Global property, 123 
Goes to, “x goes to sin(x*)”, 45 
Graph of polynomial function, 197—198 
Graph sketching, 196-201 
Graphs, 57-6576) die)? lel: veal eS, 
542 
Gravitation, 330 
Greatest lower bound, 134 
Grin and bear it, 385-386 
Gronwall’s mequality, 356 
Grow 
at the same rate as, 361 
faster than, 361 
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Hadamard, see Cauchy-Hadamard 
formula 

Half-life (of radioactive substance), 356 

Hermite, Charles, 443 


High-school student’s real numbers, 599 


Higher-order derivatives, 161] 
Hilbert, David, 443 
Horizontal axis, 57 
Hyperbola, 67, 82 

equation in polar coordinates, 88 
Hyperbolic cosine, 353 
Hyperbolic functions, 353 
Hyperbolic sine, 353 
Hyperbolic spiral, 316 
Hyperbolic tangent, 353 


Identity 
additive, 9 
multiplicative, 9 
Identity function, 43 
Identity operator, 574 
Imaginary axis, 534 
Imaginary part function, 541 
Imaginary part of a complex number, 
5311 
Implicit differentiation, 241 
Implicitly defined, 241 
Improper integral, 301—302, 397-399 
Incantation for derivative of quotient, 
i 
Increasing at a, 217 
Increasing function, 195 
Increasing sequence, 457 
Indefinite integral, 365 
Indefinite integrals, short table of, 
365 -366 
Induction, mathematical, 21 
complete, 23 
Inductive set of real numbers, 34 
Inequalities, 9 
in an ordered field, 384 
Inequality 
sernoulli’s, 32 
Cauchy-Schwarz, 281 
ecometric-arithmeuc mean, 33 
Gronwall’s, 356 
Jensen’s, 228 


Liouville’s, 448 
Schivarz, l7g33y 281 
triangle, 71 
Youne’s, 276 
Infimum, 134 
“Infinite” derivative, 158 
Infinite intervals, 57 
Infinite product, 329, 395, 497 
Infinite sequence, 452, 555 
Infinite series, 471 
multiplication of, 486 
Infinite sum, 430, 471 
Inhnite trumpet, 408 
Infinitely many primes, 32 
“Infinitely small”, 155, 264 
Infinity, 57 
minus, 57 
Inflection point, 225 
Initial conditions for differential equa- 
tions, 440 
Instantaneous speed, 152 
Instantaneous velocity, 152 
Integer, 25 
Integrable, 258 
Integral, 258 
classical notation for, 264-265 
definite, 365 
improper, 301-302, 397-399 
indefinite, 365 
short table of, 365 366 
Leibnizian notation for, see Integral, 
classical notation for 
lower, 295 
Mean Value Theorem for, 277 
Second Mean Value Theorem for, 
39] 
upper, 295 
Integral form of the remainder, 423 
Integral sign, 258 
Integral test, 478 
Integration 
by parts, 366 ff. 
by substitution, 369 II. 
limits of, 258 
of rational functions, 377 ff. 


Interest (finanee), 355 


Intermediate Value Theorem, 124, 131, 
135, 299 
Interpolation, Lagrange, 49 
Intersection of sets, 43 
Interval, 56 
closed, 57 
infinite, 57 
open, 56; see also Nested Intervals 
‘Theorem 
Inverse 
additive, 9 
multiplicative, 9 
Inverse of a function, 231 ff. 
Inverse square law, 330 
Inverses of trigonometric functions, 
see ‘Trigonometric functions 
Irrational numbers, 25 
Isomorphic fields, 602 
Isomorphism, 602 


Jensen’s mequality, 228 
Johnson, Samuel, 607 


Jump, 60 


Kepler, Johannes, 330 
Kepler’s laws of planetary motion, 330 


Lagrange form of the remainder, 423, 
436 

Lagrange interpolation formula, 49 

Large negative, 64 

Least upper bound, 133 ff, 584 

Least upper bound property, 135 

Lebesgue, see Riemann-Lebesgue 
Lemma 

Left-hand derivative, 156 

Leibniz, Gottfried Wilhelm, 155, 264 

Leibniz’s formula, 184 

Leibniz’s Theorem, 481 

Leibnizian notation for derivatives, 154- 
156, 167, 187, 241 

for higher order derivatives, 162 
Lemma, 102 
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Lemniscate, 89 
Length, 278, 283 
L’ Hopital, Marquis de, 148 
L’Ho6pital’s Rule, 204, 213-214 
Limit, 90 ff, 98, 542 
at infinity, 106 
“does not exist”, 101 
from above, 106 
from below, 106 
of a sequence, 453 
of vector-valued function, 246, 252 
uniqueness of, 100 
Limit comparison test, 475 
Limit of integration, 258 
Limit point, 469, 552 
Limit superior, 143, 467 
Lindemann, Ferdinand von, 447 
Line, real, 56 
Line, tangent, see ‘Tangent line 
Linear functions, 58 
Liouville, Joseph, 448 
Liouville’s inequality, 448 
Liouville’s Theorem, 567 
Lipschitz of order a, 210 
Local maximum point of function, 189 
higher-order derivative test for, 417 
second derivative test for, 201 


Local minimum point of function, 189; 
see also Local maximum point 
Local property, 109, 123, 166 
Local strict maximum point, 218 
Log, 341, 346 
Taylor polynomials for, 413 
remainder term for, 427 
Logarithm 
classical approach to, 357 
Napierian, 358 
of a complex number, 570 
to the base 10, 339 
Logarithmic derivative, 351 
Lower bound, 134 
almost, 142 
greatest, 134 


Lower integral, 295 
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Lower limit of integration, 258 
Lower sum, 254 
Lowest terms, 73 


Maclaurin, see Muler-Maclaurin summa- 
tion formula 
Major axis of ellipse, 87 
Mass, rate of change of, 152 
Mathematical induction, 21 
Maximum of two numbers, 16 
Maximum point of a function, 188 
local, 189; see also Local maximum 
point 
local strict, 218 
strict, 218 
Maximum value of function, 188 
Mean 
arithmetic, 33 
geometric, 33 
Mean Value Theorem, 193, 194 
Cauchy, 204 
for integrals, 277 
Second, 391 
Method of exhaustion, 141 
Minimum of function, 188 
Minimum of two numbers, 16 
Minimum point of a function, local, 
189; see also Local mmimum point 
Minor axis of ellipse, 87 
Minus mfinity, 57 
Ahinfici logarithmonum canonis description, 
358 
Modulus of a complex number, 534 
Mollerup, Johannes, 394 
Multiplication, 5 
associative law for, 9 
closure under, 9 
commutative law for, 9 
of arabic numerals , 8 
of complex numbers, 531 
geometric interpretation, 535 536 
of function and vector-valued func- 
tion, 245 
of infinite series, 486 
of number and vector, 77 
of vectors , 77 
Multiplicative identity, existence of, 9 


Multiplicative inverses, existence of, 9 
Multiplicity (ofa root), 130, [85-186 


Napier, John, 358 
Napierian logarithm, 358 
Natural numbers, 21, 34 


Negative, large, 64 

“Negative infinity”, derivative, 158 
Negative number, 9 

Negative numbers, product of two, 7 
Negative part of a function, 51 
Nested Interval Theorem, 142 
Newton, Isaac, 155, 276, 330 
Newton's law of cooling, 356 


Newton’s laws of motion, 161 
Newton’s method, 464 
Nondecreasing function, 243 
Nondecreasing sequence, 457 
Nondifferentiable complex functions, 
551 
Nonincreasing function, 243 
Nonincreasing sequence, 457 
Nonnegative function, 51 
Nonnegative sequence, 474 
Norm, 78, 252 
Notational nonsense, 573 


Nowhere differentiable continuous 
function, 509 


nth root, 71, 536 
existence of, 125, 536, 553 
primitive, 540 
Null set, 23 
Number 
algebraic, 442 
complex, 526, 531 
counting, 21] 
even, 25 
imaginary, 526 
irrational, 25 
natural, 21, 34 
odd, 25 
prime, 31 
rational, 25 
réal, 25, 534, 589 
transcendental, 442 
Numbers, basic properties of, 3 


Odd function, 51, 199 
Odd number, 25 
One-one function, 230 
Open interval, 56 
ge re 
Order of equality, 418 
Ordered field, 583 
complete, 584 
Ordered pair, 47 (footnote), 54 
Origin (of a coordinate system), 57 


Pair, 46 
ordered, 47 (footnote), 54 
Parabola, 60, 82 
area under, 263 
equation in polar coordinates, 88 
Parallelogram, 76 
Parameterized curve, tangent line of, 
246 
Parametric representation of a curve, 
244 
Partial fraction decomposition, 378 
Partial sums, 471 
Partition, 254 
Parts 
Abel’s formula for summation by, 392 
integration by, 366 ff. 
Pascal’s triangle, 27 
“reak , 6! 
Peak point, 458 
Period of a function, 71, 164, 298 
Periodic function, 71, 164, 298 
Perpendicularity of lines, 70 
beter, H., 552 
Pig, yellow, v, 375 
Pigheaded, 186 
Plane, 58 
complex, 533 
Planetary motion, Kepler’s laws of, 330 
Point, 56 
Point of contact, 220 
Point-slope form of equation of a line, 
5970 
Polar coordinates, 84 ff. 
Polynomial function, 42 
graph of, 61, 197 ff. 
multiplicity of roots, 130, 185-186 
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Polynomials, Bernoulli, 575 
Pope, Alexander, 330 
Position, rate of change of, 152 
Positive element of R, 593 
Positive elements of an ordered 
field, 583 
Positive number, 9 
Positive part of a function, 51 
Power functions, 60 
Power series, 510 
complex, 557 
centered at a, 510, 564 
Powers of 2, table of, 432 
Prime number, 31 
characteristic of a field, 586 
infinitely many of, 32 
unique factorization into, 31 
Primitive, 363 
Primitive nth root, 540 
Principia, 276 
Product, 5 
Cauchy, 493, 513 
infinite, 329, 395, 497 
of function and vector-valued func- 
tion, 245 
of functions, 43 
of number and vector, 77 
of two negative numbers, 7 
of vectors, 77 
Pyramid 
surface area of, 403 
volume of, 407 
Pythagorean theorem, 25, 58 
m, 305 
Archimedes’ approximation of, 141 
irrationality of, 326 
relation to e, 448, 564 
transcendentality of, 447 
value of, 433 
Viéte’s product for 2/7, 329 
Wallis’ product for 7/2, 395 


Quaternions, 587 
Quotient of functions, 43 
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Rabbits 
growth of population, 32 
Radian measure, 63, 304 305 
Radioactive decay, 355-356 
Radius of convergence of complex 
power series, 559 
Rate of change of mass, 152 
Rate of change of position, 152 
Ratio test, 476 
delicate, 493 
Rational functions, 42 
integration of, 377 If. 
Rational numbers, 25 
Real axis, 533 
Real line, 56 
Real number (formal definition), 589 
Real numbers, 25 
algebraist’s, 598 
analyst’s, 598 
Archimedian property of, 138 
construction of, 588 ff. 
high-school student’s, 599 
inductive set of, 34 
Real part function, 541 
Real part of a complex number, 531 
Real-valued function, 541 
Rearrangement of a sequence, 483 
“Reasonable” function, 68, 118, 149, 
180 
Rectangle, closed, 547 
Recursive definition, 23 
Reduction formulas, 377 
Regulated function, 524 
Remainder term for ‘Taylor poly- 
nomials, 421, 423, 437 
Removable discontinuity, 121 
Reparameterization, 247 
Revolution 
ellipsoid of, 405 
solid of, 402 
Riemann sum, 282 
Riemann-Lebesgue Lemma, 320, 391 
Right-hand derivative, 156 
Rismmg Sun Lemma, 143 
Rolle, Michel, 186 
Rolle’s ‘Theorem, 193 
Root 


multiplicity of, 130, 185-186 


Root of a polynomial function, 50 
double, 185; see also nth roots 
Root test, 493 
delicate, 493 


Same sign, 12 
Scalar, 78 
Scalar product of vectors, 78 
Schwarz, H. A., 217 
Schwarz inequality, 17, 33, 281 
Schwarz second derivative, 438 
Schwarzian derivative, 184 
Sec, 310 
derivative of, 310 
inverse of, see Arcsec 
Secant Inne, 150 
Second coordmate, 57 
Second derivative, 161 
Schwarz, 438 
Second derivative test for maxima and 
minima, 201 
Second Fundamental Theorem of 
Calculus, 289 
Second Mean Value Theorem for 
Integrals, 391 
Sequence 
absolutely summable, 480 
Cauchy, 459 
complex, 571 
equivalence of, 599 
complex numbers, 555 
convergent, 453 
pointwise, 502 
uniformly, 502 
decreasmg, 457 
divergent, 453, 556 
Kibonacen 32, 3204572 
increasing, 457 
infinite, 452, 555 
limit of, 453 
nondecreasing, 457 
nonincreasing, 457 
nonnegative, 474 
rearrangement of, 483 
summable, 472 
Series 
absolutely convergent, 480 
conditionally convergent, 481 


Series (continued) 
convergent, 472, 556 
Fourier, 318, 320, 323 
geometric, 473 
power, 510, 557 
Taylor, 511 
wen AE 
empty, 23 
Sets 
intersection of, 43 
notation for, 43-44 
Shadow point, 143 
Shell method, 403 
Sigma, 24 
Sign, 12 
Simpson’s rule, 401 
Sin, 43, 303-304, 306, 321-322, 563 
addition formula for, 313, 314 
derivative of, 172, 307 
inverse of, see Arcsin 
Taylor polynomials for, 412 
remainder term for, 424 
Sine, hyperbolic, 353 
Sine function, 43 
Silla) 
Sketching graphs, 196 201 
Skew field, 587 
Slope of a straight line, 58 
Solid of revolution, 402 
Speed, instantaneous, 152 
Spiral 
Archimedian, 85, 249 
hyperbolic, 316 
Square root, 12, 527 
existence of, 124 
Square root function, 546-547 
Square root in a field, 586 
Squaring the circle, 447 
Step function, 278 
Strling’s Formula, 578 
Straight line 
analytic definition, 58 


shortest distance between two points, 


278 
slope of, 58 
Strict Maximum point, 218 
Strictly convex, 228 
Sturm Comparison Theorem, 323 
Subsequence, 458 
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Substitution 
integration by, 369 {f. 
world’s sneakiest, 386 
Substitution formula, 369 
Subtraction, 5 
Sum 
finite, 3-4 
infinite, 430, 471 
lower, 254 
of an infinite sequence, 472 
of an infinite sequence of complex 
numbers, 555 
of functions, 43 
of vector-valued functions, 245 
of vectors, 75 
partial, 471 
sigma notation for, 24 
upper, 254 
Sum of squares, 552 
Summable, 472, 556 
Abel, 522 
absolutely, 480 
Cesaro, 493 
uniformly, 506 
Summation by parts, Abel’s formula for, 
392 
Supremum, 134 
Surface area 
of cone, 404 
of pyramid, 403 
of solid of revolution, 404 
Swift, Jonathan, 580 
Symmetry in graphs, 199 


Fan, 310 

derivative of, 310 

inverse of, see Arctan 

Taylor series for, 573 
Tangent, hyperbolic, 353 
Tangent line, 149, 151 

of parameterized curve, 246 

point of contact of, 220 
“Tangent line”, vertical, 158 
Yanh, 353 
Taylor polynomial, 412 ff. 

remainder term of, 421, 423, 427: 


see also specific functions 
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Taylor series, 511 
‘Taylor's Theorem, 424 
Torus, 405 
Transcendental number, 442 
‘Trapezoid rule, 400 
Triangle inequality, 71 
Trichotomy law, 9 
Trigonometric functions, 303 ©, see also 
cos, cot, csc, sec, sin, tan 
integration of, 376-377 
inverses of, 310 ff, see also arccos, 
arcsec, arcsin, arctan 
‘Trumpet 
infinite, 408 
Truncation of a polynomial, 434 
‘Two-time differentiable, 161 


Uniform limit, 502 

Uniformly continuous function, 144 
Uniformly convergent sequence, 502 
Uniformly convergent series, 506 
Uniformly distributed sequence, 469 


Uniformly summable, 506 
Uniqueness 
of factorization into primes, 31 
of limits, 100 
Unit circle, 66 
Upper bound, 133, 584 
almost, 142 
least, 133 
Upper integral, 295 
Upper limit of integration, 258 
Upper sum, 254 


“Valley”, 61 
Value 
absolute, see Absolute value 


Value of f at x, 40 


Vanishing condition, 473 
Vector-valued functions, 244 
Vector-valued functions 
determinant of, 246 
derivative of, 246 
dot product of, 246 
limit of, 246, 252 
multiplication of function by, 245 
sum of, 245 
Vectors, 75 
addition of, 75 
as forces, 76 
dot product of, 78 
multiplication by numbers, 77 
multiplication of, 77 
scalar product of, 78 
Velocity 
average, 152 
instantaneous, 152 
Vertical axis, 57 
Viete, Francois, 329 
Volume, 402-403 
of solid of revolution, 402 


Wallis’ product, 395 

Weakly convex, 228 

Weierstrass, see Bolzano-Weierstrass 
‘Theorem 

Weierstrass M-test, 507 

Well-ordering principle, 23 

Wright, Edward, 388 


Young’s inequality, 276 


Zahi, 25 
Zero, division by, 6 
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